Jul 21 14:17:52.857163 ip-10-0-140-199 systemd[1]: Starting Kubernetes Kubelet... Jul 21 14:17:53.238613 ip-10-0-140-199 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 21 14:17:53.239533 ip-10-0-140-199 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 21 14:17:53.239533 ip-10-0-140-199 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 21 14:17:53.239533 ip-10-0-140-199 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 21 14:17:53.239533 ip-10-0-140-199 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 21 14:17:53.239533 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.238747 2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 21 14:17:53.242452 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242432 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 14:17:53.242452 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242450 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 14:17:53.242452 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242454 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 14:17:53.242546 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242457 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 14:17:53.242546 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242461 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 14:17:53.242546 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242464 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 14:17:53.242546 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242466 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 14:17:53.242546 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242469 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 14:17:53.242546 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242475 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 14:17:53.242546 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242480 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 14:17:53.242546 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242483 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 14:17:53.242546 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242486 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 14:17:53.242546 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242489 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 14:17:53.242546 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242492 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 14:17:53.242546 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242494 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 14:17:53.242546 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242507 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 14:17:53.242546 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242510 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 14:17:53.242546 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242513 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 14:17:53.242546 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242515 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 14:17:53.242546 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242519 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 14:17:53.242546 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242523 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 14:17:53.242546 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242527 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 14:17:53.242983 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242531 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 14:17:53.242983 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242534 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 14:17:53.242983 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242536 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 14:17:53.242983 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242539 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 14:17:53.242983 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242542 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 14:17:53.242983 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242545 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 14:17:53.242983 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242548 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 14:17:53.242983 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242551 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 14:17:53.242983 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242554 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 14:17:53.242983 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242557 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 14:17:53.242983 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242560 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 14:17:53.242983 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242562 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 14:17:53.242983 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242565 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 14:17:53.242983 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242569 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 14:17:53.242983 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242572 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 14:17:53.242983 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242574 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 14:17:53.242983 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242577 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 14:17:53.242983 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242579 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 14:17:53.242983 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242582 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 14:17:53.242983 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242585 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 14:17:53.243479 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242587 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 14:17:53.243479 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242590 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 14:17:53.243479 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242592 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 14:17:53.243479 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242595 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 14:17:53.243479 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242597 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 14:17:53.243479 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242600 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 14:17:53.243479 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242603 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 14:17:53.243479 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242605 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 14:17:53.243479 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242608 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 14:17:53.243479 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242610 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 14:17:53.243479 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242613 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 14:17:53.243479 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242616 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 14:17:53.243479 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242619 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 14:17:53.243479 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242621 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 14:17:53.243479 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242625 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 14:17:53.243479 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242628 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 14:17:53.243479 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242630 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 14:17:53.243479 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242633 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 14:17:53.243479 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242636 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 14:17:53.243479 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242638 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 14:17:53.243986 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242641 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 14:17:53.243986 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242643 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 14:17:53.243986 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242646 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 14:17:53.243986 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242648 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 14:17:53.243986 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242651 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 14:17:53.243986 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242655 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 14:17:53.243986 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242657 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 14:17:53.243986 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242660 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 14:17:53.243986 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242662 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 14:17:53.243986 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242667 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 14:17:53.243986 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242670 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 14:17:53.243986 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242672 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 14:17:53.243986 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242675 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 14:17:53.243986 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242677 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 14:17:53.243986 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242680 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 14:17:53.243986 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242682 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 14:17:53.243986 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242685 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 14:17:53.243986 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242688 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 14:17:53.243986 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242690 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 14:17:53.244434 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242694 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 14:17:53.244434 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242696 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 14:17:53.244434 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242699 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 14:17:53.244434 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242702 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 14:17:53.244434 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242704 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 14:17:53.244434 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242707 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 14:17:53.244434 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242711 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 14:17:53.244434 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242714 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 14:17:53.244434 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242716 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 14:17:53.244434 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242718 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 14:17:53.244434 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242721 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 14:17:53.244434 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242723 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 14:17:53.244434 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242726 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 14:17:53.244434 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242728 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 14:17:53.244434 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242731 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 21 14:17:53.244434 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242733 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 14:17:53.244434 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242736 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 14:17:53.244434 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.242739 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 14:17:53.244434 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243481 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 14:17:53.244434 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243488 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 14:17:53.244917 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243491 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 14:17:53.244917 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243493 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 14:17:53.244917 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243496 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 14:17:53.244917 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243500 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 14:17:53.244917 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243502 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 14:17:53.244917 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243505 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 14:17:53.244917 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243508 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 14:17:53.244917 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243511 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 14:17:53.244917 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243514 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 14:17:53.244917 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243517 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 14:17:53.244917 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243520 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 14:17:53.244917 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243522 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 14:17:53.244917 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243525 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 21 14:17:53.244917 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243528 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 14:17:53.244917 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243530 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 14:17:53.244917 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243533 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 14:17:53.244917 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243535 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 14:17:53.244917 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243538 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 14:17:53.244917 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243541 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 14:17:53.244917 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243543 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 14:17:53.245399 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243546 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 14:17:53.245399 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243548 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 14:17:53.245399 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243552 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 14:17:53.245399 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243555 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 14:17:53.245399 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243557 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 14:17:53.245399 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243560 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 14:17:53.245399 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243562 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 14:17:53.245399 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243565 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 14:17:53.245399 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243568 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 14:17:53.245399 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243570 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 14:17:53.245399 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243573 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 14:17:53.245399 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243575 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 14:17:53.245399 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243577 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 14:17:53.245399 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243581 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 14:17:53.245399 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243584 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 14:17:53.245399 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243586 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 14:17:53.245399 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243589 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 14:17:53.245399 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243592 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 14:17:53.245399 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243594 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 14:17:53.245399 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243597 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 14:17:53.245895 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243600 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 14:17:53.245895 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243602 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 14:17:53.245895 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243605 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 14:17:53.245895 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243607 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 14:17:53.245895 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243611 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 14:17:53.245895 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243615 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 14:17:53.245895 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243618 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 14:17:53.245895 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243623 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 14:17:53.245895 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243627 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 14:17:53.245895 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243631 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 14:17:53.245895 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243634 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 14:17:53.245895 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243637 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 14:17:53.245895 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243639 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 14:17:53.245895 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243642 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 14:17:53.245895 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243645 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 14:17:53.245895 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243648 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 14:17:53.245895 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243675 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 14:17:53.245895 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243678 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 14:17:53.245895 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243681 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 14:17:53.246338 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243684 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 14:17:53.246338 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243687 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 14:17:53.246338 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243689 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 14:17:53.246338 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243692 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 14:17:53.246338 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243694 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 14:17:53.246338 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243697 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 14:17:53.246338 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243699 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 14:17:53.246338 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243702 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 14:17:53.246338 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243704 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 14:17:53.246338 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243707 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 14:17:53.246338 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243710 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 14:17:53.246338 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243713 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 14:17:53.246338 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243717 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 14:17:53.246338 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243720 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 14:17:53.246338 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243722 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 14:17:53.246338 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243725 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 14:17:53.246338 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243728 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 14:17:53.246338 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243731 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 14:17:53.246338 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243734 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 14:17:53.246833 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243736 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 14:17:53.246833 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243739 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 14:17:53.246833 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243741 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 14:17:53.246833 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243744 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 14:17:53.246833 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243746 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 14:17:53.246833 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243749 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 14:17:53.246833 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243751 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 14:17:53.246833 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243753 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 14:17:53.246833 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243756 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 14:17:53.246833 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243759 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 14:17:53.246833 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243761 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 14:17:53.246833 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243764 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 14:17:53.246833 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243766 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 14:17:53.246833 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243770 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 14:17:53.246833 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243774 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 14:17:53.246833 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243797 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 14:17:53.246833 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243801 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 14:17:53.246833 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243804 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 14:17:53.246833 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.243807 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 14:17:53.246833 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244200 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 14:17:53.247299 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244204 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 14:17:53.247299 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244207 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 14:17:53.247299 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244211 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 14:17:53.247299 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244214 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 14:17:53.247299 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244217 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 14:17:53.247299 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244220 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 14:17:53.247299 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244223 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 14:17:53.247299 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244226 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 14:17:53.247299 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244229 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 14:17:53.247299 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244232 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 14:17:53.247299 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244235 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 14:17:53.247299 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244237 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 14:17:53.247299 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244240 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 14:17:53.247299 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244242 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 14:17:53.247299 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244245 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 14:17:53.247299 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244248 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 14:17:53.247299 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244250 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 14:17:53.247299 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244253 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 14:17:53.247299 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244255 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 14:17:53.247299 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244258 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 14:17:53.247756 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244260 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 14:17:53.247756 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244263 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 14:17:53.247756 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244265 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 14:17:53.247756 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244268 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 14:17:53.247756 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244270 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 14:17:53.247756 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244273 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 14:17:53.247756 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244275 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 14:17:53.247756 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244278 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 21 14:17:53.247756 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244280 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 14:17:53.247756 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244283 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 14:17:53.247756 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244285 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 14:17:53.247756 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244287 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 14:17:53.247756 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244290 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 14:17:53.247756 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244292 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 14:17:53.247756 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244295 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 14:17:53.247756 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244297 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 14:17:53.247756 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244301 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 14:17:53.247756 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244304 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 14:17:53.247756 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244306 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 14:17:53.247756 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244308 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 14:17:53.248286 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244311 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 14:17:53.248286 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244315 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 14:17:53.248286 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244317 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 14:17:53.248286 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244320 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 14:17:53.248286 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244324 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 14:17:53.248286 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244328 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 14:17:53.248286 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244331 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 14:17:53.248286 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244333 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 14:17:53.248286 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244336 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 14:17:53.248286 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244338 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 14:17:53.248286 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244341 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 14:17:53.248286 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244343 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 14:17:53.248286 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244346 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 14:17:53.248286 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244348 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 14:17:53.248286 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244351 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 14:17:53.248286 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244354 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 14:17:53.248286 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244358 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 14:17:53.248286 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244361 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 14:17:53.248286 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244367 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 14:17:53.248729 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244370 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 14:17:53.248729 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244373 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 14:17:53.248729 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244376 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 14:17:53.248729 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244378 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 14:17:53.248729 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244381 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 14:17:53.248729 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244384 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 14:17:53.248729 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244386 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 14:17:53.248729 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244389 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 14:17:53.248729 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244391 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 14:17:53.248729 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244394 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 14:17:53.248729 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244397 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 14:17:53.248729 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244400 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 14:17:53.248729 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244403 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 14:17:53.248729 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244406 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 14:17:53.248729 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244409 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 14:17:53.248729 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244412 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 14:17:53.248729 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244414 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 14:17:53.248729 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244417 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 14:17:53.248729 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244419 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 14:17:53.248729 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244422 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 14:17:53.249253 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244424 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 14:17:53.249253 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244428 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 14:17:53.249253 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244431 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 14:17:53.249253 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244434 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 14:17:53.249253 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244437 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 14:17:53.249253 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244440 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 14:17:53.249253 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244443 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 14:17:53.249253 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244446 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 14:17:53.249253 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244449 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 14:17:53.249253 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244452 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 14:17:53.249253 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244454 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 14:17:53.249253 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244459 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 14:17:53.249253 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244461 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 14:17:53.249253 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244464 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 14:17:53.249253 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244467 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 14:17:53.249253 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244469 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 14:17:53.249253 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244472 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 14:17:53.249253 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244474 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 14:17:53.249253 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.244477 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 14:17:53.249253 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244570 2576 flags.go:64] FLAG: --address="0.0.0.0" Jul 21 14:17:53.249702 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244582 2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 21 14:17:53.249702 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244591 2576 flags.go:64] FLAG: --anonymous-auth="true" Jul 21 14:17:53.249702 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244597 2576 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 21 14:17:53.249702 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244602 2576 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 21 14:17:53.249702 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244606 2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 21 14:17:53.249702 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244611 2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 21 14:17:53.249702 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244615 2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 21 14:17:53.249702 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244619 2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 21 14:17:53.249702 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244623 2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 21 14:17:53.249702 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244626 2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 21 14:17:53.249702 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244630 2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 21 14:17:53.249702 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244633 2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 21 14:17:53.249702 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244636 2576 flags.go:64] FLAG: --cgroup-root="" Jul 21 14:17:53.249702 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244639 2576 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 21 14:17:53.249702 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244642 2576 flags.go:64] FLAG: --client-ca-file="" Jul 21 14:17:53.249702 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244645 2576 flags.go:64] FLAG: --cloud-provider="external" Jul 21 14:17:53.249702 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244648 2576 flags.go:64] FLAG: --cluster-dns="[]" Jul 21 14:17:53.249702 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244653 2576 flags.go:64] FLAG: --cluster-domain="" Jul 21 14:17:53.249702 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244656 2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 21 14:17:53.249702 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244659 2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 21 14:17:53.249702 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244663 2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 21 14:17:53.249702 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244666 2576 flags.go:64] FLAG: --container-log-max-files="5" Jul 21 14:17:53.249702 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244670 2576 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 21 14:17:53.249702 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244676 2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 21 14:17:53.250279 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244679 2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 21 14:17:53.250279 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244682 2576 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 21 14:17:53.250279 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244686 2576 flags.go:64] FLAG: --contention-profiling="false" Jul 21 14:17:53.250279 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244689 2576 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 21 14:17:53.250279 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244692 2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 21 14:17:53.250279 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244695 2576 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 21 14:17:53.250279 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244698 2576 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 21 14:17:53.250279 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244702 2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 21 14:17:53.250279 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244706 2576 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 21 14:17:53.250279 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244708 2576 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 21 14:17:53.250279 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244711 2576 flags.go:64] FLAG: --enable-load-reader="false" Jul 21 14:17:53.250279 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244715 2576 flags.go:64] FLAG: --enable-server="true" Jul 21 14:17:53.250279 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244718 2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 21 14:17:53.250279 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244727 2576 flags.go:64] FLAG: --event-burst="100" Jul 21 14:17:53.250279 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244730 2576 flags.go:64] FLAG: --event-qps="50" Jul 21 14:17:53.250279 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244733 2576 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 21 14:17:53.250279 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244737 2576 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 21 14:17:53.250279 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244739 2576 flags.go:64] FLAG: --eviction-hard="" Jul 21 14:17:53.250279 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244743 2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 21 14:17:53.250279 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244746 2576 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 21 14:17:53.250279 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244749 2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 21 14:17:53.250279 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244752 2576 flags.go:64] FLAG: --eviction-soft="" Jul 21 14:17:53.250279 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244755 2576 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 21 14:17:53.250279 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244758 2576 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 21 14:17:53.250279 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244761 2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 21 14:17:53.250897 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244764 2576 flags.go:64] FLAG: --experimental-mounter-path="" Jul 21 14:17:53.250897 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244766 2576 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 21 14:17:53.250897 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244770 2576 flags.go:64] FLAG: --fail-swap-on="true" Jul 21 14:17:53.250897 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244772 2576 flags.go:64] FLAG: --feature-gates="" Jul 21 14:17:53.250897 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244789 2576 flags.go:64] FLAG: --file-check-frequency="20s" Jul 21 14:17:53.250897 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244793 2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 21 14:17:53.250897 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244798 2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 21 14:17:53.250897 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244802 2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 21 14:17:53.250897 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244805 2576 flags.go:64] FLAG: --healthz-port="10248" Jul 21 14:17:53.250897 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244808 2576 flags.go:64] FLAG: --help="false" Jul 21 14:17:53.250897 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244811 2576 flags.go:64] FLAG: --hostname-override="ip-10-0-140-199.ec2.internal" Jul 21 14:17:53.250897 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244814 2576 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 21 14:17:53.250897 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244817 2576 flags.go:64] FLAG: --http-check-frequency="20s" Jul 21 14:17:53.250897 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244820 2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 21 14:17:53.250897 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244824 2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 21 14:17:53.250897 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244827 2576 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 21 14:17:53.250897 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244830 2576 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 21 14:17:53.250897 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244833 2576 flags.go:64] FLAG: --image-service-endpoint="" Jul 21 14:17:53.250897 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244836 2576 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 21 14:17:53.250897 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244839 2576 flags.go:64] FLAG: --kube-api-burst="100" Jul 21 14:17:53.250897 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244844 2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 21 14:17:53.250897 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244848 2576 flags.go:64] FLAG: --kube-api-qps="50" Jul 21 14:17:53.250897 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244851 2576 flags.go:64] FLAG: --kube-reserved="" Jul 21 14:17:53.250897 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244854 2576 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 21 14:17:53.251473 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244857 2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 21 14:17:53.251473 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244860 2576 flags.go:64] FLAG: --kubelet-cgroups="" Jul 21 14:17:53.251473 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244863 2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 21 14:17:53.251473 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244866 2576 flags.go:64] FLAG: --lock-file="" Jul 21 14:17:53.251473 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244869 2576 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 21 14:17:53.251473 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244873 2576 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 21 14:17:53.251473 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244876 2576 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 21 14:17:53.251473 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244881 2576 flags.go:64] FLAG: --log-json-split-stream="false" Jul 21 14:17:53.251473 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244884 2576 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 21 14:17:53.251473 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244887 2576 flags.go:64] FLAG: --log-text-split-stream="false" Jul 21 14:17:53.251473 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244890 2576 flags.go:64] FLAG: --logging-format="text" Jul 21 14:17:53.251473 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244893 2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 21 14:17:53.251473 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244896 2576 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 21 14:17:53.251473 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244899 2576 flags.go:64] FLAG: --manifest-url="" Jul 21 14:17:53.251473 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244905 2576 flags.go:64] FLAG: --manifest-url-header="" Jul 21 14:17:53.251473 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244909 2576 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 21 14:17:53.251473 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244912 2576 flags.go:64] FLAG: --max-open-files="1000000" Jul 21 14:17:53.251473 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244917 2576 flags.go:64] FLAG: --max-pods="110" Jul 21 14:17:53.251473 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244920 2576 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 21 14:17:53.251473 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244923 2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 21 14:17:53.251473 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244926 2576 flags.go:64] FLAG: --memory-manager-policy="None" Jul 21 14:17:53.251473 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244929 2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 21 14:17:53.251473 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244932 2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 21 14:17:53.251473 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244935 2576 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 21 14:17:53.251473 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244938 2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 21 14:17:53.252082 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244946 2576 flags.go:64] FLAG: --node-status-max-images="50" Jul 21 14:17:53.252082 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244949 2576 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 21 14:17:53.252082 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244953 2576 flags.go:64] FLAG: --oom-score-adj="-999" Jul 21 14:17:53.252082 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244957 2576 flags.go:64] FLAG: --pod-cidr="" Jul 21 14:17:53.252082 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244961 2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 21 14:17:53.252082 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244966 2576 flags.go:64] FLAG: --pod-manifest-path="" Jul 21 14:17:53.252082 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244970 2576 flags.go:64] FLAG: --pod-max-pids="-1" Jul 21 14:17:53.252082 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244973 2576 flags.go:64] FLAG: --pods-per-core="0" Jul 21 14:17:53.252082 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244976 2576 flags.go:64] FLAG: --port="10250" Jul 21 14:17:53.252082 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244979 2576 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 21 14:17:53.252082 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244982 2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-079f995c662e06339" Jul 21 14:17:53.252082 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244985 2576 flags.go:64] FLAG: --qos-reserved="" Jul 21 14:17:53.252082 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244988 2576 flags.go:64] FLAG: --read-only-port="10255" Jul 21 14:17:53.252082 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244991 2576 flags.go:64] FLAG: --register-node="true" Jul 21 14:17:53.252082 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244994 2576 flags.go:64] FLAG: --register-with-taints="" Jul 21 14:17:53.252082 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.244998 2576 flags.go:64] FLAG: --registry-burst="10" Jul 21 14:17:53.252082 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.245001 2576 flags.go:64] FLAG: --registry-qps="5" Jul 21 14:17:53.252082 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.245004 2576 flags.go:64] FLAG: --reserved-cpus="" Jul 21 14:17:53.252082 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.245007 2576 flags.go:64] FLAG: --reserved-memory="" Jul 21 14:17:53.252082 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.245011 2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 21 14:17:53.252082 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.245014 2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 21 14:17:53.252082 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.245018 2576 flags.go:64] FLAG: --rotate-certificates="false" Jul 21 14:17:53.252082 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.245022 2576 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 21 14:17:53.252082 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.245025 2576 flags.go:64] FLAG: --runonce="false" Jul 21 14:17:53.252082 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.245028 2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 21 14:17:53.252720 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.245031 2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 21 14:17:53.252720 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.245034 2576 flags.go:64] FLAG: --seccomp-default="false" Jul 21 14:17:53.252720 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.245037 2576 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 21 14:17:53.252720 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.245040 2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 21 14:17:53.252720 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.245043 2576 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 21 14:17:53.252720 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.245046 2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 21 14:17:53.252720 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.245049 2576 flags.go:64] FLAG: --storage-driver-password="root" Jul 21 14:17:53.252720 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.245052 2576 flags.go:64] FLAG: --storage-driver-secure="false" Jul 21 14:17:53.252720 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.245054 2576 flags.go:64] FLAG: --storage-driver-table="stats" Jul 21 14:17:53.252720 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.245057 2576 flags.go:64] FLAG: --storage-driver-user="root" Jul 21 14:17:53.252720 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.245062 2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 21 14:17:53.252720 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.245065 2576 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 21 14:17:53.252720 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.245068 2576 flags.go:64] FLAG: --system-cgroups="" Jul 21 14:17:53.252720 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.245071 2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 21 14:17:53.252720 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.245077 2576 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 21 14:17:53.252720 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.245080 2576 flags.go:64] FLAG: --tls-cert-file="" Jul 21 14:17:53.252720 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.245083 2576 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 21 14:17:53.252720 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.245087 2576 flags.go:64] FLAG: --tls-min-version="" Jul 21 14:17:53.252720 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.245090 2576 flags.go:64] FLAG: --tls-private-key-file="" Jul 21 14:17:53.252720 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.245093 2576 flags.go:64] FLAG: --topology-manager-policy="none" Jul 21 14:17:53.252720 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.245096 2576 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 21 14:17:53.252720 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.245099 2576 flags.go:64] FLAG: --topology-manager-scope="container" Jul 21 14:17:53.252720 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.245102 2576 flags.go:64] FLAG: --v="2" Jul 21 14:17:53.252720 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.245106 2576 flags.go:64] FLAG: --version="false" Jul 21 14:17:53.252720 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.245110 2576 flags.go:64] FLAG: --vmodule="" Jul 21 14:17:53.253335 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.245114 2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 21 14:17:53.253335 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.245117 2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 21 14:17:53.253335 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245242 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 14:17:53.253335 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245247 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 14:17:53.253335 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245252 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 14:17:53.253335 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245255 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 14:17:53.253335 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245257 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 14:17:53.253335 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245260 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 14:17:53.253335 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245263 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 14:17:53.253335 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245265 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 14:17:53.253335 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245268 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 14:17:53.253335 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245270 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 14:17:53.253335 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245273 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 14:17:53.253335 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245276 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 14:17:53.253335 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245278 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 14:17:53.253335 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245281 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 14:17:53.253335 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245284 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 14:17:53.253335 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245288 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 14:17:53.253335 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245291 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 14:17:53.253335 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245293 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 14:17:53.253837 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245296 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 14:17:53.253837 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245299 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 21 14:17:53.253837 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245302 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 14:17:53.253837 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245305 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 14:17:53.253837 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245307 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 14:17:53.253837 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245310 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 14:17:53.253837 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245313 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 14:17:53.253837 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245315 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 14:17:53.253837 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245318 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 14:17:53.253837 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245321 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 14:17:53.253837 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245323 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 14:17:53.253837 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245326 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 14:17:53.253837 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245328 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 14:17:53.253837 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245331 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 14:17:53.253837 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245333 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 14:17:53.253837 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245336 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 14:17:53.253837 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245340 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 14:17:53.253837 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245342 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 14:17:53.253837 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245345 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 14:17:53.253837 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245348 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 14:17:53.254318 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245351 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 14:17:53.254318 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245353 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 14:17:53.254318 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245358 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 14:17:53.254318 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245361 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 14:17:53.254318 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245364 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 14:17:53.254318 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245367 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 14:17:53.254318 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245370 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 14:17:53.254318 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245372 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 14:17:53.254318 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245375 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 14:17:53.254318 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245379 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 14:17:53.254318 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245382 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 14:17:53.254318 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245384 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 14:17:53.254318 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245387 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 14:17:53.254318 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245390 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 14:17:53.254318 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245393 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 14:17:53.254318 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245395 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 14:17:53.254318 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245398 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 14:17:53.254318 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245400 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 14:17:53.254318 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245403 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 14:17:53.254768 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245406 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 14:17:53.254768 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245409 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 14:17:53.254768 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245411 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 14:17:53.254768 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245414 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 14:17:53.254768 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245418 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 14:17:53.254768 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245421 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 14:17:53.254768 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245424 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 14:17:53.254768 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245427 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 14:17:53.254768 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245430 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 14:17:53.254768 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245435 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 14:17:53.254768 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245438 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 14:17:53.254768 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245440 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 14:17:53.254768 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245443 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 14:17:53.254768 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245446 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 14:17:53.254768 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245449 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 14:17:53.254768 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245451 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 14:17:53.254768 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245454 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 14:17:53.254768 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245456 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 14:17:53.254768 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245459 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 14:17:53.255231 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245461 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 14:17:53.255231 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245464 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 14:17:53.255231 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245466 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 14:17:53.255231 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245470 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 14:17:53.255231 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245473 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 14:17:53.255231 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245476 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 14:17:53.255231 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245478 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 14:17:53.255231 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245481 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 14:17:53.255231 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245483 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 14:17:53.255231 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245486 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 14:17:53.255231 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245488 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 14:17:53.255231 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245491 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 14:17:53.255231 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245493 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 14:17:53.255231 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245496 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 14:17:53.255231 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245498 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 14:17:53.255231 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245501 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 14:17:53.255231 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245503 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 14:17:53.255231 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245506 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 14:17:53.255231 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245510 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 14:17:53.255686 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245513 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 14:17:53.255686 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245516 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 14:17:53.255686 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245518 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 14:17:53.255686 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.245522 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 14:17:53.255686 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.246711 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 21 14:17:53.255686 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.253271 2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 21 14:17:53.255686 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.253286 2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 21 14:17:53.255686 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.253301 2576 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 21 14:17:53.255686 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.253306 2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 21 14:17:53.255686 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253361 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 14:17:53.255686 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253366 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 14:17:53.255686 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253369 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 14:17:53.255686 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253373 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 14:17:53.255686 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253376 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 21 14:17:53.255686 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253379 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 14:17:53.256070 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253382 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 14:17:53.256070 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253385 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 14:17:53.256070 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253388 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 14:17:53.256070 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253391 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 14:17:53.256070 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253393 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 14:17:53.256070 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253396 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 14:17:53.256070 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253400 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 14:17:53.256070 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253403 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 14:17:53.256070 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253405 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 14:17:53.256070 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253408 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 14:17:53.256070 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253412 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 14:17:53.256070 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253416 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 14:17:53.256070 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253419 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 14:17:53.256070 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253422 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 14:17:53.256070 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253425 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 14:17:53.256070 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253427 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 14:17:53.256070 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253430 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 14:17:53.256070 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253433 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 14:17:53.256070 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253436 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 14:17:53.256518 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253438 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 14:17:53.256518 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253441 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 14:17:53.256518 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253444 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 14:17:53.256518 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253447 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 14:17:53.256518 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253450 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 14:17:53.256518 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253453 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 14:17:53.256518 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253456 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 14:17:53.256518 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253458 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 14:17:53.256518 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253461 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 14:17:53.256518 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253464 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 14:17:53.256518 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253466 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 14:17:53.256518 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253469 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 14:17:53.256518 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253471 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 14:17:53.256518 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253474 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 14:17:53.256518 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253476 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 14:17:53.256518 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253479 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 14:17:53.256518 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253482 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 14:17:53.256518 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253484 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 14:17:53.256518 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253487 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 14:17:53.256518 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253490 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 14:17:53.257025 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253493 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 14:17:53.257025 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253496 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 14:17:53.257025 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253498 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 14:17:53.257025 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253500 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 14:17:53.257025 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253503 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 14:17:53.257025 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253507 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 14:17:53.257025 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253510 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 14:17:53.257025 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253513 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 14:17:53.257025 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253516 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 14:17:53.257025 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253519 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 14:17:53.257025 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253522 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 14:17:53.257025 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253524 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 14:17:53.257025 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253527 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 14:17:53.257025 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253529 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 14:17:53.257025 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253532 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 14:17:53.257025 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253534 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 14:17:53.257025 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253537 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 14:17:53.257025 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253540 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 14:17:53.257025 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253543 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 14:17:53.257481 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253547 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 14:17:53.257481 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253550 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 14:17:53.257481 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253553 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 14:17:53.257481 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253556 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 14:17:53.257481 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253558 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 14:17:53.257481 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253561 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 14:17:53.257481 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253563 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 14:17:53.257481 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253566 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 14:17:53.257481 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253568 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 14:17:53.257481 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253571 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 14:17:53.257481 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253573 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 14:17:53.257481 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253576 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 14:17:53.257481 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253579 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 14:17:53.257481 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253581 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 14:17:53.257481 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253584 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 14:17:53.257481 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253587 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 14:17:53.257481 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253589 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 14:17:53.257481 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253592 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 14:17:53.257481 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253594 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 14:17:53.257481 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253597 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 14:17:53.258075 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253599 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 14:17:53.258075 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253602 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 14:17:53.258075 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253604 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 14:17:53.258075 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253607 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 14:17:53.258075 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253609 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 14:17:53.258075 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253612 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 14:17:53.258075 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253615 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 14:17:53.258075 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253617 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 14:17:53.258075 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253620 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 14:17:53.258075 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253623 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 14:17:53.258075 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253626 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 14:17:53.258075 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253629 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 14:17:53.258075 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253631 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 14:17:53.258075 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253634 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 14:17:53.258075 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253636 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 14:17:53.258502 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.253641 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 21 14:17:53.258502 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253754 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 14:17:53.258502 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253758 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 14:17:53.258502 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253761 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 14:17:53.258502 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253764 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 14:17:53.258502 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253766 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 14:17:53.258502 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253769 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 14:17:53.258502 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253772 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 14:17:53.258502 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253791 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 14:17:53.258502 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253796 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 14:17:53.258502 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253799 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 14:17:53.258502 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253802 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 14:17:53.258502 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253805 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 14:17:53.258502 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253808 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 14:17:53.258502 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253811 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 14:17:53.258899 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253813 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 14:17:53.258899 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253816 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 14:17:53.258899 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253818 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 14:17:53.258899 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253822 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 14:17:53.258899 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253827 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 14:17:53.258899 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253830 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 14:17:53.258899 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253832 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 14:17:53.258899 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253835 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 14:17:53.258899 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253837 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 14:17:53.258899 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253841 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 14:17:53.258899 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253845 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 14:17:53.258899 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253848 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 14:17:53.258899 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253851 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 14:17:53.258899 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253854 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 14:17:53.258899 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253857 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 14:17:53.258899 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253860 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 14:17:53.258899 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253863 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 14:17:53.258899 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253865 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 14:17:53.258899 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253868 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 14:17:53.259575 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253871 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 14:17:53.259575 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253873 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 14:17:53.259575 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253876 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 14:17:53.259575 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253878 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 14:17:53.259575 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253881 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 14:17:53.259575 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253883 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 14:17:53.259575 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253886 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 14:17:53.259575 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253889 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 14:17:53.259575 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253891 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 14:17:53.259575 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253894 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 14:17:53.259575 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253896 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 14:17:53.259575 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253900 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 14:17:53.259575 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253902 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 14:17:53.259575 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253905 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 14:17:53.259575 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253907 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 14:17:53.259575 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253910 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 14:17:53.259575 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253912 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 14:17:53.259575 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253915 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 14:17:53.259575 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253917 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 14:17:53.259575 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253920 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 14:17:53.260138 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253923 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 14:17:53.260138 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253926 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 14:17:53.260138 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253928 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 14:17:53.260138 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253932 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 14:17:53.260138 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253936 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 14:17:53.260138 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253939 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 14:17:53.260138 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253942 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 14:17:53.260138 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253945 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 14:17:53.260138 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253947 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 14:17:53.260138 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253950 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 14:17:53.260138 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253953 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 14:17:53.260138 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253955 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 14:17:53.260138 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253958 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 14:17:53.260138 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253960 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 14:17:53.260138 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253963 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 14:17:53.260138 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253965 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 14:17:53.260138 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253968 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 14:17:53.260138 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253970 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 14:17:53.260138 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253973 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 14:17:53.260138 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253975 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 14:17:53.260644 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253978 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 14:17:53.260644 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253980 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 14:17:53.260644 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253983 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 14:17:53.260644 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253986 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 14:17:53.260644 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253988 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 14:17:53.260644 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253991 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 14:17:53.260644 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253993 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 14:17:53.260644 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253996 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 14:17:53.260644 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.253999 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 14:17:53.260644 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.254001 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 14:17:53.260644 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.254004 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 14:17:53.260644 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.254006 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 14:17:53.260644 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.254009 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 14:17:53.260644 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.254011 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 21 14:17:53.260644 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.254014 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 14:17:53.260644 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.254016 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 14:17:53.260644 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.254019 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 14:17:53.260644 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.254021 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 14:17:53.260644 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.254024 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 14:17:53.260644 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.254026 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 14:17:53.261258 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.254029 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 14:17:53.261258 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.254032 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 14:17:53.261258 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.254034 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 14:17:53.261258 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.254036 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 14:17:53.261258 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.254039 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 14:17:53.261258 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:53.254042 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 14:17:53.261258 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.254047 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 21 14:17:53.261258 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.254159 2576 server.go:962] "Client rotation is on, will bootstrap in background" Jul 21 14:17:53.261258 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.256108 2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 21 14:17:53.261258 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.257898 2576 server.go:1019] "Starting client certificate rotation" Jul 21 14:17:53.261258 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.258000 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 21 14:17:53.261258 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.258074 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 21 14:17:53.264859 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.264795 2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 21 14:17:53.266594 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.266559 2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 21 14:17:53.278193 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.278156 2576 log.go:25] "Validated CRI v1 runtime API" Jul 21 14:17:53.280851 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.280828 2576 log.go:25] "Validated CRI v1 image API" Jul 21 14:17:53.282108 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.282089 2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 21 14:17:53.284604 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.284575 2576 fs.go:135] Filesystem UUIDs: map[5d56b7be-caa4-4f60-bc5f-dbfe2131d39b:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 c7c55570-6be5-4bde-b247-eff7cd4491e5:/dev/nvme0n1p3] Jul 21 14:17:53.284703 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.284601 2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 21 14:17:53.291065 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.290936 2576 manager.go:216] Machine: {Timestamp:2026-07-21 14:17:53.289478012 +0000 UTC m=+0.307381577 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099041 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b181b3bb1d1b13cbbb07ad4c2446f SystemUUID:ec2b181b-3bb1-d1b1-3cbb-b07ad4c2446f BootID:4c84ae03-0276-4b6e-802b-bd7fa0760dfc Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:50:cd:70:8b:69 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:50:cd:70:8b:69 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ee:ec:62:8d:d8:c3 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 21 14:17:53.291065 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.291061 2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 21 14:17:53.291179 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.291160 2576 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 21 14:17:53.292832 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.292798 2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 21 14:17:53.293027 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.292841 2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-199.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 21 14:17:53.294110 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.294099 2576 topology_manager.go:138] "Creating topology manager with none policy" Jul 21 14:17:53.294142 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.294113 2576 container_manager_linux.go:309] "Creating device plugin manager" Jul 21 14:17:53.294142 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.294126 2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 21 14:17:53.294898 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.294882 2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 21 14:17:53.296327 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.296302 2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 21 14:17:53.299114 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.299075 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 21 14:17:53.299608 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.299582 2576 state_mem.go:36] "Initialized new in-memory state store" Jul 21 14:17:53.299891 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.299873 2576 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 21 14:17:53.299963 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.299949 2576 kubelet.go:486] "Attempting to sync node with API server" Jul 21 14:17:53.300051 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.299974 2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 21 14:17:53.300051 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.300006 2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 21 14:17:53.300051 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.300029 2576 kubelet.go:398] "Adding apiserver pod source" Jul 21 14:17:53.300051 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.300047 2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 21 14:17:53.300829 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.300805 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 21 14:17:53.300956 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.300842 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 21 14:17:53.303823 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.303427 2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 21 14:17:53.307222 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.307173 2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 21 14:17:53.307222 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.307227 2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 21 14:17:53.308960 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.308931 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 21 14:17:53.308960 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.308966 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 21 14:17:53.309053 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.308976 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 21 14:17:53.309053 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.308983 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 21 14:17:53.309053 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.308996 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 21 14:17:53.309053 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.309004 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 21 14:17:53.309053 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.309015 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 21 14:17:53.309053 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.309022 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 21 14:17:53.309053 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.309033 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 21 14:17:53.309053 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.309042 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 21 14:17:53.309053 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.309058 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 21 14:17:53.309335 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.309064 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 21 14:17:53.309747 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.309729 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 21 14:17:53.309747 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.309747 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 21 14:17:53.311886 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:17:53.311821 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 21 14:17:53.311886 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:17:53.311857 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-199.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 21 14:17:53.316020 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.315981 2576 server.go:1268] "Started kubelet" Jul 21 14:17:53.316133 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.316079 2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 21 14:17:53.316596 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.316253 2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 21 14:17:53.316596 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.316410 2576 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 21 14:17:53.317921 ip-10-0-140-199 systemd[1]: Started Kubernetes Kubelet. Jul 21 14:17:53.319232 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.319200 2576 server.go:310] "Adding debug handlers to kubelet server" Jul 21 14:17:53.324725 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.324688 2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-199.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 21 14:17:53.325015 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:17:53.324972 2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 21 14:17:53.325256 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.325237 2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 21 14:17:53.325394 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:17:53.324537 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-199.ec2.internal.18c453c895b6c28f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-199.ec2.internal,UID:ip-10-0-140-199.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-199.ec2.internal,},FirstTimestamp:2026-07-21 14:17:53.315906191 +0000 UTC m=+0.333809755,LastTimestamp:2026-07-21 14:17:53.315906191 +0000 UTC m=+0.333809755,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-199.ec2.internal,}" Jul 21 14:17:53.331343 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.331309 2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 21 14:17:53.331499 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.331390 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 21 14:17:53.331553 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.331536 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cmpbh" Jul 21 14:17:53.331642 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:17:53.331622 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-199.ec2.internal\" not found" Jul 21 14:17:53.332175 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.332152 2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 21 14:17:53.332301 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.332263 2576 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 21 14:17:53.332301 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.332279 2576 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 21 14:17:53.332437 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.332422 2576 reconstruct.go:97] "Volume reconstruction finished" Jul 21 14:17:53.332475 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.332437 2576 reconciler.go:29] "Reconciler: start to sync state" Jul 21 14:17:53.332850 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.332830 2576 factory.go:55] Registering systemd factory Jul 21 14:17:53.332850 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.332849 2576 factory.go:223] Registration of the systemd container factory successfully Jul 21 14:17:53.333091 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.333077 2576 factory.go:153] Registering CRI-O factory Jul 21 14:17:53.333091 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.333093 2576 factory.go:223] Registration of the crio container factory successfully Jul 21 14:17:53.333196 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.333147 2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 21 14:17:53.333196 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.333171 2576 factory.go:103] Registering Raw factory Jul 21 14:17:53.333196 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.333184 2576 manager.go:1196] Started watching for new ooms in manager Jul 21 14:17:53.333886 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:17:53.333846 2576 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-199.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 21 14:17:53.334023 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.333980 2576 manager.go:349] Starting recovery of all containers Jul 21 14:17:53.334346 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:17:53.334317 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 21 14:17:53.343102 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.343037 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cmpbh" Jul 21 14:17:53.352262 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.351056 2576 manager.go:354] Recovery completed Jul 21 14:17:53.354934 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:17:53.354855 2576 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 21 14:17:53.359592 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.359570 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 14:17:53.362118 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.362086 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-199.ec2.internal" event="NodeHasSufficientMemory" Jul 21 14:17:53.362277 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.362144 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-199.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 14:17:53.362277 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.362161 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-199.ec2.internal" event="NodeHasSufficientPID" Jul 21 14:17:53.363076 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.363053 2576 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 21 14:17:53.363076 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.363072 2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 21 14:17:53.363278 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.363099 2576 state_mem.go:36] "Initialized new in-memory state store" Jul 21 14:17:53.363278 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.363104 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 14:17:53.363937 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.363918 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-199.ec2.internal" event="NodeHasSufficientMemory" Jul 21 14:17:53.364050 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.363957 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-199.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 14:17:53.364050 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.363980 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-199.ec2.internal" event="NodeHasSufficientPID" Jul 21 14:17:53.364818 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.364799 2576 policy_none.go:49] "None policy: Start" Jul 21 14:17:53.364879 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.364832 2576 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 21 14:17:53.364879 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.364846 2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 21 14:17:53.366090 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.366069 2576 policy_none.go:47] "Start" Jul 21 14:17:53.406560 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.406542 2576 manager.go:337] "Starting Device Plugin manager" Jul 21 14:17:53.406679 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:17:53.406576 2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 21 14:17:53.406679 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.406587 2576 server.go:87] "Starting device plugin registration server" Jul 21 14:17:53.406906 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.406894 2576 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 21 14:17:53.406952 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.406907 2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 21 14:17:53.407024 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.407003 2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 21 14:17:53.407140 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.407124 2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 21 14:17:53.407140 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.407138 2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 21 14:17:53.407879 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:17:53.407856 2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 21 14:17:53.407967 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:17:53.407905 2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-199.ec2.internal\" not found" Jul 21 14:17:53.507327 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.507237 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 14:17:53.508606 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.508199 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-199.ec2.internal" event="NodeHasSufficientMemory" Jul 21 14:17:53.508606 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.508237 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-199.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 14:17:53.508606 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.508255 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-199.ec2.internal" event="NodeHasSufficientPID" Jul 21 14:17:53.508606 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.508287 2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-199.ec2.internal" Jul 21 14:17:53.517101 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.517069 2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-199.ec2.internal" Jul 21 14:17:53.517277 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:17:53.517113 2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-199.ec2.internal\": node \"ip-10-0-140-199.ec2.internal\" not found" Jul 21 14:17:53.517328 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.517245 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 21 14:17:53.519124 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.519076 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 21 14:17:53.519311 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.519147 2576 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 21 14:17:53.519311 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.519183 2576 kubelet.go:2448] "Starting kubelet main sync loop" Jul 21 14:17:53.519311 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:17:53.519240 2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 21 14:17:53.521183 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.521149 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 14:17:53.566796 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:17:53.566746 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-199.ec2.internal\" not found" Jul 21 14:17:53.619836 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.619772 2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-199.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-199.ec2.internal"] Jul 21 14:17:53.620110 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.619920 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 14:17:53.621110 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.621088 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-199.ec2.internal" event="NodeHasSufficientMemory" Jul 21 14:17:53.621239 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.621135 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-199.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 14:17:53.621239 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.621150 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-199.ec2.internal" event="NodeHasSufficientPID" Jul 21 14:17:53.622700 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.622673 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 14:17:53.622847 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.622807 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-199.ec2.internal" Jul 21 14:17:53.622847 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.622847 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 14:17:53.623836 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.623807 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-199.ec2.internal" event="NodeHasSufficientMemory" Jul 21 14:17:53.623976 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.623845 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-199.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 14:17:53.623976 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.623857 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-199.ec2.internal" event="NodeHasSufficientPID" Jul 21 14:17:53.623976 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.623807 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-199.ec2.internal" event="NodeHasSufficientMemory" Jul 21 14:17:53.623976 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.623921 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-199.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 14:17:53.623976 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.623932 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-199.ec2.internal" event="NodeHasSufficientPID" Jul 21 14:17:53.625445 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.625423 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-199.ec2.internal" Jul 21 14:17:53.625558 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.625458 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 14:17:53.626464 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.626441 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-199.ec2.internal" event="NodeHasSufficientMemory" Jul 21 14:17:53.626564 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.626482 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-199.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 14:17:53.626564 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.626497 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-199.ec2.internal" event="NodeHasSufficientPID" Jul 21 14:17:53.634681 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.634640 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d39c96e45fa97134bd3353fcd622d146-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-199.ec2.internal\" (UID: \"d39c96e45fa97134bd3353fcd622d146\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-199.ec2.internal" Jul 21 14:17:53.634681 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.634680 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d39c96e45fa97134bd3353fcd622d146-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-199.ec2.internal\" (UID: \"d39c96e45fa97134bd3353fcd622d146\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-199.ec2.internal" Jul 21 14:17:53.634929 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.634698 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1fa232d68d89be7b5a77b2100c544fdb-config\") pod \"kube-apiserver-proxy-ip-10-0-140-199.ec2.internal\" (UID: \"1fa232d68d89be7b5a77b2100c544fdb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-199.ec2.internal" Jul 21 14:17:53.644624 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:17:53.644586 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-199.ec2.internal\" not found" node="ip-10-0-140-199.ec2.internal" Jul 21 14:17:53.648741 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:17:53.648714 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-199.ec2.internal\" not found" node="ip-10-0-140-199.ec2.internal" Jul 21 14:17:53.667048 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:17:53.667015 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-199.ec2.internal\" not found" Jul 21 14:17:53.735739 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.735686 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d39c96e45fa97134bd3353fcd622d146-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-199.ec2.internal\" (UID: \"d39c96e45fa97134bd3353fcd622d146\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-199.ec2.internal" Jul 21 14:17:53.735739 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.735737 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d39c96e45fa97134bd3353fcd622d146-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-199.ec2.internal\" (UID: \"d39c96e45fa97134bd3353fcd622d146\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-199.ec2.internal" Jul 21 14:17:53.736029 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.735799 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d39c96e45fa97134bd3353fcd622d146-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-199.ec2.internal\" (UID: \"d39c96e45fa97134bd3353fcd622d146\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-199.ec2.internal" Jul 21 14:17:53.736029 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.735818 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d39c96e45fa97134bd3353fcd622d146-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-199.ec2.internal\" (UID: \"d39c96e45fa97134bd3353fcd622d146\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-199.ec2.internal" Jul 21 14:17:53.736029 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.735869 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1fa232d68d89be7b5a77b2100c544fdb-config\") pod \"kube-apiserver-proxy-ip-10-0-140-199.ec2.internal\" (UID: \"1fa232d68d89be7b5a77b2100c544fdb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-199.ec2.internal" Jul 21 14:17:53.736029 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.735923 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1fa232d68d89be7b5a77b2100c544fdb-config\") pod \"kube-apiserver-proxy-ip-10-0-140-199.ec2.internal\" (UID: \"1fa232d68d89be7b5a77b2100c544fdb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-199.ec2.internal" Jul 21 14:17:53.767463 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:17:53.767327 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-199.ec2.internal\" not found" Jul 21 14:17:53.868224 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:17:53.868144 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-199.ec2.internal\" not found" Jul 21 14:17:53.947838 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.947760 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-199.ec2.internal" Jul 21 14:17:53.951496 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:53.951447 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-199.ec2.internal" Jul 21 14:17:53.968531 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:17:53.968490 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-199.ec2.internal\" not found" Jul 21 14:17:54.069372 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:17:54.069187 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-199.ec2.internal\" not found" Jul 21 14:17:54.169817 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:17:54.169742 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-199.ec2.internal\" not found" Jul 21 14:17:54.257474 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:54.257415 2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 21 14:17:54.258150 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:54.257695 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 21 14:17:54.270794 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:17:54.270730 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-199.ec2.internal\" not found" Jul 21 14:17:54.352903 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:54.352770 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-20 14:12:53 +0000 UTC" deadline="2028-02-08 15:29:12.635629804 +0000 UTC" Jul 21 14:17:54.352903 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:54.352835 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13609h11m18.282798381s" Jul 21 14:17:54.371915 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:17:54.371874 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-199.ec2.internal\" not found" Jul 21 14:17:54.472767 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:17:54.472700 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-199.ec2.internal\" not found" Jul 21 14:17:54.573840 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:17:54.573777 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-199.ec2.internal\" not found" Jul 21 14:17:54.595688 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:54.595646 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd39c96e45fa97134bd3353fcd622d146.slice/crio-d3173a6132f464b22ca674724fc82a621d22cb0a399ee22b22a251eed099b4a1 WatchSource:0}: Error finding container d3173a6132f464b22ca674724fc82a621d22cb0a399ee22b22a251eed099b4a1: Status 404 returned error can't find the container with id d3173a6132f464b22ca674724fc82a621d22cb0a399ee22b22a251eed099b4a1 Jul 21 14:17:54.602131 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:54.602106 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 21 14:17:54.676489 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:17:54.676428 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-199.ec2.internal\" not found" Jul 21 14:17:54.685169 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:54.685138 2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 14:17:54.777042 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:17:54.776959 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-199.ec2.internal\" not found" Jul 21 14:17:54.789625 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:54.789571 2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 14:17:54.879720 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:17:54.879630 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-199.ec2.internal\" not found" Jul 21 14:17:54.885230 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:54.885200 2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 14:17:54.932603 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:54.932537 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-199.ec2.internal" Jul 21 14:17:54.947677 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:54.947640 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 21 14:17:54.948897 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:54.948877 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-199.ec2.internal" Jul 21 14:17:54.959544 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:54.959510 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 21 14:17:55.301669 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.301630 2576 apiserver.go:52] "Watching apiserver" Jul 21 14:17:55.313144 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.313097 2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 21 14:17:55.314399 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.314356 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-199.ec2.internal","openshift-multus/multus-additional-cni-plugins-vhrsj","openshift-network-operator/iptables-alerter-2ct2w","openshift-ovn-kubernetes/ovnkube-node-c4p99","kube-system/global-pull-secret-syncer-4r4d6","kube-system/konnectivity-agent-gfgt6","kube-system/kube-apiserver-proxy-ip-10-0-140-199.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjfwt","openshift-cluster-node-tuning-operator/tuned-pnsb2","openshift-multus/multus-hs4wq","openshift-multus/network-metrics-daemon-9tpq5","openshift-network-diagnostics/network-check-target-fttn7","openshift-dns/node-resolver-b5kkg","openshift-image-registry/node-ca-nxm5s"] Jul 21 14:17:55.317247 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.317212 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hs4wq" Jul 21 14:17:55.319243 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.319190 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9tpq5" Jul 21 14:17:55.319432 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:17:55.319345 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9tpq5" podUID="f208bc8d-9c6c-4dc0-a7e3-a95c9e26c3d6" Jul 21 14:17:55.320905 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.320873 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nxm5s" Jul 21 14:17:55.321738 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.321720 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-tkhdk\"" Jul 21 14:17:55.322078 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.322050 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 21 14:17:55.322259 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.322120 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 21 14:17:55.322259 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.322127 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 21 14:17:55.322259 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.322207 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 21 14:17:55.322525 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.322507 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-c4p99" Jul 21 14:17:55.323599 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.323578 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 21 14:17:55.324198 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.324173 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 21 14:17:55.324609 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.324584 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zsh5h\"" Jul 21 14:17:55.324609 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.324598 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjfwt" Jul 21 14:17:55.324776 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.324647 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 21 14:17:55.326152 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.326129 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gfgt6" Jul 21 14:17:55.327876 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.327842 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pnsb2" Jul 21 14:17:55.328206 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.328179 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-mv2w8\"" Jul 21 14:17:55.328498 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.328481 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 21 14:17:55.329566 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.329537 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-b5kkg" Jul 21 14:17:55.330198 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.330041 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 21 14:17:55.330198 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.330060 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 21 14:17:55.330198 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.330123 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 21 14:17:55.330406 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.330216 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 21 14:17:55.331914 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.331886 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 21 14:17:55.333577 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.332326 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vhrsj" Jul 21 14:17:55.335098 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.334503 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 21 14:17:55.335098 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.334536 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-w9dtm\"" Jul 21 14:17:55.335224 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.335120 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-t6swq\"" Jul 21 14:17:55.335550 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.335522 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 21 14:17:55.335550 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.335538 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 21 14:17:55.335725 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.335683 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 21 14:17:55.336080 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.336054 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 21 14:17:55.336171 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.336074 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 21 14:17:55.336171 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.336129 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 21 14:17:55.336271 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.336215 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 21 14:17:55.336323 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.336295 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 21 14:17:55.336451 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.336432 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-sk9kn\"" Jul 21 14:17:55.336910 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.336840 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 21 14:17:55.337018 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.336980 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-59mf9\"" Jul 21 14:17:55.337109 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.337084 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 21 14:17:55.337681 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.337656 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fttn7" Jul 21 14:17:55.338011 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:17:55.337929 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fttn7" podUID="9d5c37aa-d496-4010-942a-92ead7dfa6b1" Jul 21 14:17:55.338349 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.338323 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 21 14:17:55.338711 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.338685 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-n6k44\"" Jul 21 14:17:55.341124 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.341100 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4r4d6" Jul 21 14:17:55.341262 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:17:55.341224 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4r4d6" podUID="6ab945a0-5e72-4852-8a76-462020ef4af6" Jul 21 14:17:55.342868 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.342836 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2ct2w" Jul 21 14:17:55.344703 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.344684 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clhjq\" (UniqueName: \"kubernetes.io/projected/8ccfca56-0054-4006-be8c-2fb53147addd-kube-api-access-clhjq\") pod \"node-ca-nxm5s\" (UID: \"8ccfca56-0054-4006-be8c-2fb53147addd\") " pod="openshift-image-registry/node-ca-nxm5s" Jul 21 14:17:55.344773 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.344714 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/10f6f6de-8f81-4811-9798-9bec360e01f7-node-log\") pod \"ovnkube-node-c4p99\" (UID: \"10f6f6de-8f81-4811-9798-9bec360e01f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4p99" Jul 21 14:17:55.344773 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.344744 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/10f6f6de-8f81-4811-9798-9bec360e01f7-ovnkube-config\") pod \"ovnkube-node-c4p99\" (UID: \"10f6f6de-8f81-4811-9798-9bec360e01f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4p99" Jul 21 14:17:55.344837 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.344773 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7d09a08b-bf2f-43b1-8ab2-91176c9db0db-device-dir\") pod \"aws-ebs-csi-driver-node-zjfwt\" (UID: \"7d09a08b-bf2f-43b1-8ab2-91176c9db0db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjfwt" Jul 21 14:17:55.344837 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.344798 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6ad32aaa-9b75-431d-b467-6e3e01db7864-hostroot\") pod \"multus-hs4wq\" (UID: \"6ad32aaa-9b75-431d-b467-6e3e01db7864\") " pod="openshift-multus/multus-hs4wq" Jul 21 14:17:55.344837 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.344819 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/10f6f6de-8f81-4811-9798-9bec360e01f7-host-run-netns\") pod \"ovnkube-node-c4p99\" (UID: \"10f6f6de-8f81-4811-9798-9bec360e01f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4p99" Jul 21 14:17:55.344951 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.344871 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/10f6f6de-8f81-4811-9798-9bec360e01f7-run-systemd\") pod \"ovnkube-node-c4p99\" (UID: \"10f6f6de-8f81-4811-9798-9bec360e01f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4p99" Jul 21 14:17:55.344951 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.344920 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/10f6f6de-8f81-4811-9798-9bec360e01f7-run-openvswitch\") pod \"ovnkube-node-c4p99\" (UID: \"10f6f6de-8f81-4811-9798-9bec360e01f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4p99" Jul 21 14:17:55.345010 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.344950 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/10f6f6de-8f81-4811-9798-9bec360e01f7-host-cni-netd\") pod \"ovnkube-node-c4p99\" (UID: \"10f6f6de-8f81-4811-9798-9bec360e01f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4p99" Jul 21 14:17:55.345010 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.344978 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10-etc-sysconfig\") pod \"tuned-pnsb2\" (UID: \"f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10\") " pod="openshift-cluster-node-tuning-operator/tuned-pnsb2" Jul 21 14:17:55.345097 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.345018 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10-etc-sysctl-conf\") pod \"tuned-pnsb2\" (UID: \"f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10\") " pod="openshift-cluster-node-tuning-operator/tuned-pnsb2" Jul 21 14:17:55.345097 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.345058 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10-etc-tuned\") pod \"tuned-pnsb2\" (UID: \"f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10\") " pod="openshift-cluster-node-tuning-operator/tuned-pnsb2" Jul 21 14:17:55.345097 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.345084 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6ad32aaa-9b75-431d-b467-6e3e01db7864-multus-cni-dir\") pod \"multus-hs4wq\" (UID: \"6ad32aaa-9b75-431d-b467-6e3e01db7864\") " pod="openshift-multus/multus-hs4wq" Jul 21 14:17:55.345189 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.345112 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/32d461fa-ba21-427d-b9de-24cceea9e7c1-konnectivity-ca\") pod \"konnectivity-agent-gfgt6\" (UID: \"32d461fa-ba21-427d-b9de-24cceea9e7c1\") " pod="kube-system/konnectivity-agent-gfgt6" Jul 21 14:17:55.345189 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.345138 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10-etc-sysctl-d\") pod \"tuned-pnsb2\" (UID: \"f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10\") " pod="openshift-cluster-node-tuning-operator/tuned-pnsb2" Jul 21 14:17:55.345189 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.345181 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8r54v\" (UniqueName: \"kubernetes.io/projected/08737a2e-4e32-441c-b905-c2a2e41b1d17-kube-api-access-8r54v\") pod \"node-resolver-b5kkg\" (UID: \"08737a2e-4e32-441c-b905-c2a2e41b1d17\") " pod="openshift-dns/node-resolver-b5kkg" Jul 21 14:17:55.345277 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.345209 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6ad32aaa-9b75-431d-b467-6e3e01db7864-multus-daemon-config\") pod \"multus-hs4wq\" (UID: \"6ad32aaa-9b75-431d-b467-6e3e01db7864\") " pod="openshift-multus/multus-hs4wq" Jul 21 14:17:55.345277 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.345237 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/10f6f6de-8f81-4811-9798-9bec360e01f7-log-socket\") pod \"ovnkube-node-c4p99\" (UID: \"10f6f6de-8f81-4811-9798-9bec360e01f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4p99" Jul 21 14:17:55.345357 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.345269 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7d09a08b-bf2f-43b1-8ab2-91176c9db0db-sys-fs\") pod \"aws-ebs-csi-driver-node-zjfwt\" (UID: \"7d09a08b-bf2f-43b1-8ab2-91176c9db0db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjfwt" Jul 21 14:17:55.345357 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.345312 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c22b3b26-5ab0-4206-aee9-9f10dbe890a1-os-release\") pod \"multus-additional-cni-plugins-vhrsj\" (UID: \"c22b3b26-5ab0-4206-aee9-9f10dbe890a1\") " pod="openshift-multus/multus-additional-cni-plugins-vhrsj" Jul 21 14:17:55.345357 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.345337 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c22b3b26-5ab0-4206-aee9-9f10dbe890a1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vhrsj\" (UID: \"c22b3b26-5ab0-4206-aee9-9f10dbe890a1\") " pod="openshift-multus/multus-additional-cni-plugins-vhrsj" Jul 21 14:17:55.345453 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.345364 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6ad32aaa-9b75-431d-b467-6e3e01db7864-os-release\") pod \"multus-hs4wq\" (UID: \"6ad32aaa-9b75-431d-b467-6e3e01db7864\") " pod="openshift-multus/multus-hs4wq" Jul 21 14:17:55.345453 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.345390 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/10f6f6de-8f81-4811-9798-9bec360e01f7-env-overrides\") pod \"ovnkube-node-c4p99\" (UID: \"10f6f6de-8f81-4811-9798-9bec360e01f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4p99" Jul 21 14:17:55.345520 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.345487 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10-run\") pod \"tuned-pnsb2\" (UID: \"f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10\") " pod="openshift-cluster-node-tuning-operator/tuned-pnsb2" Jul 21 14:17:55.345553 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.345519 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6ad32aaa-9b75-431d-b467-6e3e01db7864-host-var-lib-cni-bin\") pod \"multus-hs4wq\" (UID: \"6ad32aaa-9b75-431d-b467-6e3e01db7864\") " pod="openshift-multus/multus-hs4wq" Jul 21 14:17:55.345553 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.345546 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7d09a08b-bf2f-43b1-8ab2-91176c9db0db-etc-selinux\") pod \"aws-ebs-csi-driver-node-zjfwt\" (UID: \"7d09a08b-bf2f-43b1-8ab2-91176c9db0db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjfwt" Jul 21 14:17:55.345635 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.345572 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f208bc8d-9c6c-4dc0-a7e3-a95c9e26c3d6-metrics-certs\") pod \"network-metrics-daemon-9tpq5\" (UID: \"f208bc8d-9c6c-4dc0-a7e3-a95c9e26c3d6\") " pod="openshift-multus/network-metrics-daemon-9tpq5" Jul 21 14:17:55.345635 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.345598 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/10f6f6de-8f81-4811-9798-9bec360e01f7-ovn-node-metrics-cert\") pod \"ovnkube-node-c4p99\" (UID: \"10f6f6de-8f81-4811-9798-9bec360e01f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4p99" Jul 21 14:17:55.345710 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.345625 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8ccfca56-0054-4006-be8c-2fb53147addd-host\") pod \"node-ca-nxm5s\" (UID: \"8ccfca56-0054-4006-be8c-2fb53147addd\") " pod="openshift-image-registry/node-ca-nxm5s" Jul 21 14:17:55.345710 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.345665 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/10f6f6de-8f81-4811-9798-9bec360e01f7-host-slash\") pod \"ovnkube-node-c4p99\" (UID: \"10f6f6de-8f81-4811-9798-9bec360e01f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4p99" Jul 21 14:17:55.345710 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.345689 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/10f6f6de-8f81-4811-9798-9bec360e01f7-run-ovn\") pod \"ovnkube-node-c4p99\" (UID: \"10f6f6de-8f81-4811-9798-9bec360e01f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4p99" Jul 21 14:17:55.345813 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.345714 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7d09a08b-bf2f-43b1-8ab2-91176c9db0db-registration-dir\") pod \"aws-ebs-csi-driver-node-zjfwt\" (UID: \"7d09a08b-bf2f-43b1-8ab2-91176c9db0db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjfwt" Jul 21 14:17:55.345813 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.345745 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c22b3b26-5ab0-4206-aee9-9f10dbe890a1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vhrsj\" (UID: \"c22b3b26-5ab0-4206-aee9-9f10dbe890a1\") " pod="openshift-multus/multus-additional-cni-plugins-vhrsj" Jul 21 14:17:55.345906 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.345823 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/32d461fa-ba21-427d-b9de-24cceea9e7c1-agent-certs\") pod \"konnectivity-agent-gfgt6\" (UID: \"32d461fa-ba21-427d-b9de-24cceea9e7c1\") " pod="kube-system/konnectivity-agent-gfgt6" Jul 21 14:17:55.345906 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.345852 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10-var-lib-kubelet\") pod \"tuned-pnsb2\" (UID: \"f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10\") " pod="openshift-cluster-node-tuning-operator/tuned-pnsb2" Jul 21 14:17:55.345906 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.345895 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6ad32aaa-9b75-431d-b467-6e3e01db7864-cnibin\") pod \"multus-hs4wq\" (UID: \"6ad32aaa-9b75-431d-b467-6e3e01db7864\") " pod="openshift-multus/multus-hs4wq" Jul 21 14:17:55.346041 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.345920 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrb74\" (UniqueName: \"kubernetes.io/projected/9d5c37aa-d496-4010-942a-92ead7dfa6b1-kube-api-access-wrb74\") pod \"network-check-target-fttn7\" (UID: \"9d5c37aa-d496-4010-942a-92ead7dfa6b1\") " pod="openshift-network-diagnostics/network-check-target-fttn7" Jul 21 14:17:55.346041 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.345941 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10-host\") pod \"tuned-pnsb2\" (UID: \"f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10\") " pod="openshift-cluster-node-tuning-operator/tuned-pnsb2" Jul 21 14:17:55.346041 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.346001 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c22b3b26-5ab0-4206-aee9-9f10dbe890a1-system-cni-dir\") pod \"multus-additional-cni-plugins-vhrsj\" (UID: \"c22b3b26-5ab0-4206-aee9-9f10dbe890a1\") " pod="openshift-multus/multus-additional-cni-plugins-vhrsj" Jul 21 14:17:55.346184 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.346053 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c22b3b26-5ab0-4206-aee9-9f10dbe890a1-cnibin\") pod \"multus-additional-cni-plugins-vhrsj\" (UID: \"c22b3b26-5ab0-4206-aee9-9f10dbe890a1\") " pod="openshift-multus/multus-additional-cni-plugins-vhrsj" Jul 21 14:17:55.346184 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.346104 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6ad32aaa-9b75-431d-b467-6e3e01db7864-cni-binary-copy\") pod \"multus-hs4wq\" (UID: \"6ad32aaa-9b75-431d-b467-6e3e01db7864\") " pod="openshift-multus/multus-hs4wq" Jul 21 14:17:55.346184 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.346108 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 21 14:17:55.346184 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.346130 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6ad32aaa-9b75-431d-b467-6e3e01db7864-multus-socket-dir-parent\") pod \"multus-hs4wq\" (UID: \"6ad32aaa-9b75-431d-b467-6e3e01db7864\") " pod="openshift-multus/multus-hs4wq" Jul 21 14:17:55.346184 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.346157 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qlbz\" (UniqueName: \"kubernetes.io/projected/6ad32aaa-9b75-431d-b467-6e3e01db7864-kube-api-access-7qlbz\") pod \"multus-hs4wq\" (UID: \"6ad32aaa-9b75-431d-b467-6e3e01db7864\") " pod="openshift-multus/multus-hs4wq" Jul 21 14:17:55.346412 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.346203 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/10f6f6de-8f81-4811-9798-9bec360e01f7-host-cni-bin\") pod \"ovnkube-node-c4p99\" (UID: \"10f6f6de-8f81-4811-9798-9bec360e01f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4p99" Jul 21 14:17:55.346412 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.346231 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10-etc-kubernetes\") pod \"tuned-pnsb2\" (UID: \"f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10\") " pod="openshift-cluster-node-tuning-operator/tuned-pnsb2" Jul 21 14:17:55.346412 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.346255 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10-sys\") pod \"tuned-pnsb2\" (UID: \"f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10\") " pod="openshift-cluster-node-tuning-operator/tuned-pnsb2" Jul 21 14:17:55.346412 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.346280 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c22b3b26-5ab0-4206-aee9-9f10dbe890a1-cni-binary-copy\") pod \"multus-additional-cni-plugins-vhrsj\" (UID: \"c22b3b26-5ab0-4206-aee9-9f10dbe890a1\") " pod="openshift-multus/multus-additional-cni-plugins-vhrsj" Jul 21 14:17:55.346412 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.346307 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c22b3b26-5ab0-4206-aee9-9f10dbe890a1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vhrsj\" (UID: \"c22b3b26-5ab0-4206-aee9-9f10dbe890a1\") " pod="openshift-multus/multus-additional-cni-plugins-vhrsj" Jul 21 14:17:55.346412 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.346335 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6ad32aaa-9b75-431d-b467-6e3e01db7864-host-run-k8s-cni-cncf-io\") pod \"multus-hs4wq\" (UID: \"6ad32aaa-9b75-431d-b467-6e3e01db7864\") " pod="openshift-multus/multus-hs4wq" Jul 21 14:17:55.346412 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.346363 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6ad32aaa-9b75-431d-b467-6e3e01db7864-multus-conf-dir\") pod \"multus-hs4wq\" (UID: \"6ad32aaa-9b75-431d-b467-6e3e01db7864\") " pod="openshift-multus/multus-hs4wq" Jul 21 14:17:55.346412 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.346395 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fhs8\" (UniqueName: \"kubernetes.io/projected/10f6f6de-8f81-4811-9798-9bec360e01f7-kube-api-access-7fhs8\") pod \"ovnkube-node-c4p99\" (UID: \"10f6f6de-8f81-4811-9798-9bec360e01f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4p99" Jul 21 14:17:55.346787 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.346448 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7d09a08b-bf2f-43b1-8ab2-91176c9db0db-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zjfwt\" (UID: \"7d09a08b-bf2f-43b1-8ab2-91176c9db0db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjfwt" Jul 21 14:17:55.346787 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.346476 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7d09a08b-bf2f-43b1-8ab2-91176c9db0db-socket-dir\") pod \"aws-ebs-csi-driver-node-zjfwt\" (UID: \"7d09a08b-bf2f-43b1-8ab2-91176c9db0db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjfwt" Jul 21 14:17:55.346787 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.346514 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8ccfca56-0054-4006-be8c-2fb53147addd-serviceca\") pod \"node-ca-nxm5s\" (UID: \"8ccfca56-0054-4006-be8c-2fb53147addd\") " pod="openshift-image-registry/node-ca-nxm5s" Jul 21 14:17:55.346787 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.346539 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmkh5\" (UniqueName: \"kubernetes.io/projected/c22b3b26-5ab0-4206-aee9-9f10dbe890a1-kube-api-access-wmkh5\") pod \"multus-additional-cni-plugins-vhrsj\" (UID: \"c22b3b26-5ab0-4206-aee9-9f10dbe890a1\") " pod="openshift-multus/multus-additional-cni-plugins-vhrsj" Jul 21 14:17:55.346787 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.346625 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6ad32aaa-9b75-431d-b467-6e3e01db7864-system-cni-dir\") pod \"multus-hs4wq\" (UID: \"6ad32aaa-9b75-431d-b467-6e3e01db7864\") " pod="openshift-multus/multus-hs4wq" Jul 21 14:17:55.346787 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.346651 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/10f6f6de-8f81-4811-9798-9bec360e01f7-systemd-units\") pod \"ovnkube-node-c4p99\" (UID: \"10f6f6de-8f81-4811-9798-9bec360e01f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4p99" Jul 21 14:17:55.346787 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.346676 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/10f6f6de-8f81-4811-9798-9bec360e01f7-etc-openvswitch\") pod \"ovnkube-node-c4p99\" (UID: \"10f6f6de-8f81-4811-9798-9bec360e01f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4p99" Jul 21 14:17:55.346787 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.346727 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/10f6f6de-8f81-4811-9798-9bec360e01f7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-c4p99\" (UID: \"10f6f6de-8f81-4811-9798-9bec360e01f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4p99" Jul 21 14:17:55.347222 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.346761 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bx6h7\" (UniqueName: \"kubernetes.io/projected/7d09a08b-bf2f-43b1-8ab2-91176c9db0db-kube-api-access-bx6h7\") pod \"aws-ebs-csi-driver-node-zjfwt\" (UID: \"7d09a08b-bf2f-43b1-8ab2-91176c9db0db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjfwt" Jul 21 14:17:55.347222 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.346852 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10-etc-systemd\") pod \"tuned-pnsb2\" (UID: \"f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10\") " pod="openshift-cluster-node-tuning-operator/tuned-pnsb2" Jul 21 14:17:55.347222 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.346902 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08737a2e-4e32-441c-b905-c2a2e41b1d17-tmp-dir\") pod \"node-resolver-b5kkg\" (UID: \"08737a2e-4e32-441c-b905-c2a2e41b1d17\") " pod="openshift-dns/node-resolver-b5kkg" Jul 21 14:17:55.347222 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.346910 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 21 14:17:55.347222 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.346945 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6ad32aaa-9b75-431d-b467-6e3e01db7864-host-var-lib-cni-multus\") pod \"multus-hs4wq\" (UID: \"6ad32aaa-9b75-431d-b467-6e3e01db7864\") " pod="openshift-multus/multus-hs4wq" Jul 21 14:17:55.347222 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.346981 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ad32aaa-9b75-431d-b467-6e3e01db7864-host-var-lib-kubelet\") pod \"multus-hs4wq\" (UID: \"6ad32aaa-9b75-431d-b467-6e3e01db7864\") " pod="openshift-multus/multus-hs4wq" Jul 21 14:17:55.347222 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.347011 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6ad32aaa-9b75-431d-b467-6e3e01db7864-host-run-multus-certs\") pod \"multus-hs4wq\" (UID: \"6ad32aaa-9b75-431d-b467-6e3e01db7864\") " pod="openshift-multus/multus-hs4wq" Jul 21 14:17:55.347222 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.347037 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-889tm\"" Jul 21 14:17:55.347222 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.347059 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/10f6f6de-8f81-4811-9798-9bec360e01f7-var-lib-openvswitch\") pod \"ovnkube-node-c4p99\" (UID: \"10f6f6de-8f81-4811-9798-9bec360e01f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4p99" Jul 21 14:17:55.347222 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.347091 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/10f6f6de-8f81-4811-9798-9bec360e01f7-host-run-ovn-kubernetes\") pod \"ovnkube-node-c4p99\" (UID: \"10f6f6de-8f81-4811-9798-9bec360e01f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4p99" Jul 21 14:17:55.347222 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.347115 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkfq2\" (UniqueName: \"kubernetes.io/projected/f208bc8d-9c6c-4dc0-a7e3-a95c9e26c3d6-kube-api-access-pkfq2\") pod \"network-metrics-daemon-9tpq5\" (UID: \"f208bc8d-9c6c-4dc0-a7e3-a95c9e26c3d6\") " pod="openshift-multus/network-metrics-daemon-9tpq5" Jul 21 14:17:55.347222 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.347164 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10-lib-modules\") pod \"tuned-pnsb2\" (UID: \"f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10\") " pod="openshift-cluster-node-tuning-operator/tuned-pnsb2" Jul 21 14:17:55.347222 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.347192 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 21 14:17:55.347222 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.347199 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10-tmp\") pod \"tuned-pnsb2\" (UID: \"f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10\") " pod="openshift-cluster-node-tuning-operator/tuned-pnsb2" Jul 21 14:17:55.347764 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.347230 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9c59\" (UniqueName: \"kubernetes.io/projected/f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10-kube-api-access-t9c59\") pod \"tuned-pnsb2\" (UID: \"f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10\") " pod="openshift-cluster-node-tuning-operator/tuned-pnsb2" Jul 21 14:17:55.347764 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.347256 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10-etc-modprobe-d\") pod \"tuned-pnsb2\" (UID: \"f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10\") " pod="openshift-cluster-node-tuning-operator/tuned-pnsb2" Jul 21 14:17:55.347764 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.347283 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/10f6f6de-8f81-4811-9798-9bec360e01f7-ovnkube-script-lib\") pod \"ovnkube-node-c4p99\" (UID: \"10f6f6de-8f81-4811-9798-9bec360e01f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4p99" Jul 21 14:17:55.347764 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.347311 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/10f6f6de-8f81-4811-9798-9bec360e01f7-host-kubelet\") pod \"ovnkube-node-c4p99\" (UID: \"10f6f6de-8f81-4811-9798-9bec360e01f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4p99" Jul 21 14:17:55.347764 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.347345 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6ad32aaa-9b75-431d-b467-6e3e01db7864-host-run-netns\") pod \"multus-hs4wq\" (UID: \"6ad32aaa-9b75-431d-b467-6e3e01db7864\") " pod="openshift-multus/multus-hs4wq" Jul 21 14:17:55.347764 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.347369 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/08737a2e-4e32-441c-b905-c2a2e41b1d17-hosts-file\") pod \"node-resolver-b5kkg\" (UID: \"08737a2e-4e32-441c-b905-c2a2e41b1d17\") " pod="openshift-dns/node-resolver-b5kkg" Jul 21 14:17:55.347764 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.347394 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ad32aaa-9b75-431d-b467-6e3e01db7864-etc-kubernetes\") pod \"multus-hs4wq\" (UID: \"6ad32aaa-9b75-431d-b467-6e3e01db7864\") " pod="openshift-multus/multus-hs4wq" Jul 21 14:17:55.347764 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.347748 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 21 14:17:55.378041 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.378000 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-swddd" Jul 21 14:17:55.387254 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.387222 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-swddd" Jul 21 14:17:55.433480 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.433430 2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 21 14:17:55.448620 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.448578 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c22b3b26-5ab0-4206-aee9-9f10dbe890a1-system-cni-dir\") pod \"multus-additional-cni-plugins-vhrsj\" (UID: \"c22b3b26-5ab0-4206-aee9-9f10dbe890a1\") " pod="openshift-multus/multus-additional-cni-plugins-vhrsj" Jul 21 14:17:55.448853 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.448623 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c22b3b26-5ab0-4206-aee9-9f10dbe890a1-cnibin\") pod \"multus-additional-cni-plugins-vhrsj\" (UID: \"c22b3b26-5ab0-4206-aee9-9f10dbe890a1\") " pod="openshift-multus/multus-additional-cni-plugins-vhrsj" Jul 21 14:17:55.448853 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.448663 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6ad32aaa-9b75-431d-b467-6e3e01db7864-cni-binary-copy\") pod \"multus-hs4wq\" (UID: \"6ad32aaa-9b75-431d-b467-6e3e01db7864\") " pod="openshift-multus/multus-hs4wq" Jul 21 14:17:55.448853 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.448690 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6ad32aaa-9b75-431d-b467-6e3e01db7864-multus-socket-dir-parent\") pod \"multus-hs4wq\" (UID: \"6ad32aaa-9b75-431d-b467-6e3e01db7864\") " pod="openshift-multus/multus-hs4wq" Jul 21 14:17:55.448853 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.448738 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qlbz\" (UniqueName: \"kubernetes.io/projected/6ad32aaa-9b75-431d-b467-6e3e01db7864-kube-api-access-7qlbz\") pod \"multus-hs4wq\" (UID: \"6ad32aaa-9b75-431d-b467-6e3e01db7864\") " pod="openshift-multus/multus-hs4wq" Jul 21 14:17:55.448853 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.448760 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c22b3b26-5ab0-4206-aee9-9f10dbe890a1-cnibin\") pod \"multus-additional-cni-plugins-vhrsj\" (UID: \"c22b3b26-5ab0-4206-aee9-9f10dbe890a1\") " pod="openshift-multus/multus-additional-cni-plugins-vhrsj" Jul 21 14:17:55.448853 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.448832 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/10f6f6de-8f81-4811-9798-9bec360e01f7-host-cni-bin\") pod \"ovnkube-node-c4p99\" (UID: \"10f6f6de-8f81-4811-9798-9bec360e01f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4p99" Jul 21 14:17:55.448853 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.448843 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6ad32aaa-9b75-431d-b467-6e3e01db7864-multus-socket-dir-parent\") pod \"multus-hs4wq\" (UID: \"6ad32aaa-9b75-431d-b467-6e3e01db7864\") " pod="openshift-multus/multus-hs4wq" Jul 21 14:17:55.449144 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.448871 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/10f6f6de-8f81-4811-9798-9bec360e01f7-host-cni-bin\") pod \"ovnkube-node-c4p99\" (UID: \"10f6f6de-8f81-4811-9798-9bec360e01f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4p99" Jul 21 14:17:55.449144 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.448760 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c22b3b26-5ab0-4206-aee9-9f10dbe890a1-system-cni-dir\") pod \"multus-additional-cni-plugins-vhrsj\" (UID: \"c22b3b26-5ab0-4206-aee9-9f10dbe890a1\") " pod="openshift-multus/multus-additional-cni-plugins-vhrsj" Jul 21 14:17:55.449144 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.448942 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10-etc-kubernetes\") pod \"tuned-pnsb2\" (UID: \"f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10\") " pod="openshift-cluster-node-tuning-operator/tuned-pnsb2" Jul 21 14:17:55.449144 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.448981 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10-sys\") pod \"tuned-pnsb2\" (UID: \"f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10\") " pod="openshift-cluster-node-tuning-operator/tuned-pnsb2" Jul 21 14:17:55.449144 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.449004 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10-etc-kubernetes\") pod \"tuned-pnsb2\" (UID: \"f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10\") " pod="openshift-cluster-node-tuning-operator/tuned-pnsb2" Jul 21 14:17:55.449144 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.449014 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c22b3b26-5ab0-4206-aee9-9f10dbe890a1-cni-binary-copy\") pod \"multus-additional-cni-plugins-vhrsj\" (UID: \"c22b3b26-5ab0-4206-aee9-9f10dbe890a1\") " pod="openshift-multus/multus-additional-cni-plugins-vhrsj" Jul 21 14:17:55.449144 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.449045 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c22b3b26-5ab0-4206-aee9-9f10dbe890a1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vhrsj\" (UID: \"c22b3b26-5ab0-4206-aee9-9f10dbe890a1\") " pod="openshift-multus/multus-additional-cni-plugins-vhrsj" Jul 21 14:17:55.449144 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.449071 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10-sys\") pod \"tuned-pnsb2\" (UID: \"f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10\") " pod="openshift-cluster-node-tuning-operator/tuned-pnsb2" Jul 21 14:17:55.449144 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.449074 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6ad32aaa-9b75-431d-b467-6e3e01db7864-host-run-k8s-cni-cncf-io\") pod \"multus-hs4wq\" (UID: \"6ad32aaa-9b75-431d-b467-6e3e01db7864\") " pod="openshift-multus/multus-hs4wq" Jul 21 14:17:55.449144 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.449122 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6ad32aaa-9b75-431d-b467-6e3e01db7864-host-run-k8s-cni-cncf-io\") pod \"multus-hs4wq\" (UID: \"6ad32aaa-9b75-431d-b467-6e3e01db7864\") " pod="openshift-multus/multus-hs4wq" Jul 21 14:17:55.449773 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.449162 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6ad32aaa-9b75-431d-b467-6e3e01db7864-multus-conf-dir\") pod \"multus-hs4wq\" (UID: \"6ad32aaa-9b75-431d-b467-6e3e01db7864\") " pod="openshift-multus/multus-hs4wq" Jul 21 14:17:55.449773 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.449189 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fhs8\" (UniqueName: \"kubernetes.io/projected/10f6f6de-8f81-4811-9798-9bec360e01f7-kube-api-access-7fhs8\") pod \"ovnkube-node-c4p99\" (UID: \"10f6f6de-8f81-4811-9798-9bec360e01f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4p99" Jul 21 14:17:55.449773 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.449216 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7d09a08b-bf2f-43b1-8ab2-91176c9db0db-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zjfwt\" (UID: \"7d09a08b-bf2f-43b1-8ab2-91176c9db0db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjfwt" Jul 21 14:17:55.449773 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.449248 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7d09a08b-bf2f-43b1-8ab2-91176c9db0db-socket-dir\") pod \"aws-ebs-csi-driver-node-zjfwt\" (UID: \"7d09a08b-bf2f-43b1-8ab2-91176c9db0db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjfwt" Jul 21 14:17:55.449773 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.449257 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6ad32aaa-9b75-431d-b467-6e3e01db7864-multus-conf-dir\") pod \"multus-hs4wq\" (UID: \"6ad32aaa-9b75-431d-b467-6e3e01db7864\") " pod="openshift-multus/multus-hs4wq" Jul 21 14:17:55.449773 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.449313 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7d09a08b-bf2f-43b1-8ab2-91176c9db0db-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zjfwt\" (UID: \"7d09a08b-bf2f-43b1-8ab2-91176c9db0db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjfwt" Jul 21 14:17:55.449773 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.449362 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8ccfca56-0054-4006-be8c-2fb53147addd-serviceca\") pod \"node-ca-nxm5s\" (UID: \"8ccfca56-0054-4006-be8c-2fb53147addd\") " pod="openshift-image-registry/node-ca-nxm5s" Jul 21 14:17:55.449773 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.449402 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmkh5\" (UniqueName: \"kubernetes.io/projected/c22b3b26-5ab0-4206-aee9-9f10dbe890a1-kube-api-access-wmkh5\") pod \"multus-additional-cni-plugins-vhrsj\" (UID: \"c22b3b26-5ab0-4206-aee9-9f10dbe890a1\") " pod="openshift-multus/multus-additional-cni-plugins-vhrsj" Jul 21 14:17:55.449773 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.449491 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6ad32aaa-9b75-431d-b467-6e3e01db7864-system-cni-dir\") pod \"multus-hs4wq\" (UID: \"6ad32aaa-9b75-431d-b467-6e3e01db7864\") " pod="openshift-multus/multus-hs4wq" Jul 21 14:17:55.449773 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.449492 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7d09a08b-bf2f-43b1-8ab2-91176c9db0db-socket-dir\") pod \"aws-ebs-csi-driver-node-zjfwt\" (UID: \"7d09a08b-bf2f-43b1-8ab2-91176c9db0db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjfwt" Jul 21 14:17:55.449773 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.449579 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6ad32aaa-9b75-431d-b467-6e3e01db7864-system-cni-dir\") pod \"multus-hs4wq\" (UID: \"6ad32aaa-9b75-431d-b467-6e3e01db7864\") " pod="openshift-multus/multus-hs4wq" Jul 21 14:17:55.449773 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.449691 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/10f6f6de-8f81-4811-9798-9bec360e01f7-systemd-units\") pod \"ovnkube-node-c4p99\" (UID: \"10f6f6de-8f81-4811-9798-9bec360e01f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4p99" Jul 21 14:17:55.450361 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.449821 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6ad32aaa-9b75-431d-b467-6e3e01db7864-cni-binary-copy\") pod \"multus-hs4wq\" (UID: \"6ad32aaa-9b75-431d-b467-6e3e01db7864\") " pod="openshift-multus/multus-hs4wq" Jul 21 14:17:55.450361 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.449871 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5g5k\" (UniqueName: \"kubernetes.io/projected/4d2e67d2-585f-46a1-9bff-fd6583e1d6f2-kube-api-access-c5g5k\") pod \"iptables-alerter-2ct2w\" (UID: \"4d2e67d2-585f-46a1-9bff-fd6583e1d6f2\") " pod="openshift-network-operator/iptables-alerter-2ct2w" Jul 21 14:17:55.450361 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.449961 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/10f6f6de-8f81-4811-9798-9bec360e01f7-systemd-units\") pod \"ovnkube-node-c4p99\" (UID: \"10f6f6de-8f81-4811-9798-9bec360e01f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4p99" Jul 21 14:17:55.450361 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.449987 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/10f6f6de-8f81-4811-9798-9bec360e01f7-etc-openvswitch\") pod \"ovnkube-node-c4p99\" (UID: \"10f6f6de-8f81-4811-9798-9bec360e01f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4p99" Jul 21 14:17:55.450361 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.450006 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c22b3b26-5ab0-4206-aee9-9f10dbe890a1-cni-binary-copy\") pod \"multus-additional-cni-plugins-vhrsj\" (UID: \"c22b3b26-5ab0-4206-aee9-9f10dbe890a1\") " pod="openshift-multus/multus-additional-cni-plugins-vhrsj" Jul 21 14:17:55.450361 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.450019 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/10f6f6de-8f81-4811-9798-9bec360e01f7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-c4p99\" (UID: \"10f6f6de-8f81-4811-9798-9bec360e01f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4p99" Jul 21 14:17:55.450361 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.450043 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bx6h7\" (UniqueName: \"kubernetes.io/projected/7d09a08b-bf2f-43b1-8ab2-91176c9db0db-kube-api-access-bx6h7\") pod \"aws-ebs-csi-driver-node-zjfwt\" (UID: \"7d09a08b-bf2f-43b1-8ab2-91176c9db0db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjfwt" Jul 21 14:17:55.450361 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.450041 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/10f6f6de-8f81-4811-9798-9bec360e01f7-etc-openvswitch\") pod \"ovnkube-node-c4p99\" (UID: \"10f6f6de-8f81-4811-9798-9bec360e01f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4p99" Jul 21 14:17:55.450361 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.450062 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10-etc-systemd\") pod \"tuned-pnsb2\" (UID: \"f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10\") " pod="openshift-cluster-node-tuning-operator/tuned-pnsb2" Jul 21 14:17:55.450361 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.450077 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/10f6f6de-8f81-4811-9798-9bec360e01f7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-c4p99\" (UID: \"10f6f6de-8f81-4811-9798-9bec360e01f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4p99" Jul 21 14:17:55.450361 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.450064 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8ccfca56-0054-4006-be8c-2fb53147addd-serviceca\") pod \"node-ca-nxm5s\" (UID: \"8ccfca56-0054-4006-be8c-2fb53147addd\") " pod="openshift-image-registry/node-ca-nxm5s" Jul 21 14:17:55.450361 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.450110 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08737a2e-4e32-441c-b905-c2a2e41b1d17-tmp-dir\") pod \"node-resolver-b5kkg\" (UID: \"08737a2e-4e32-441c-b905-c2a2e41b1d17\") " pod="openshift-dns/node-resolver-b5kkg" Jul 21 14:17:55.450361 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.450150 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6ad32aaa-9b75-431d-b467-6e3e01db7864-host-var-lib-cni-multus\") pod \"multus-hs4wq\" (UID: \"6ad32aaa-9b75-431d-b467-6e3e01db7864\") " pod="openshift-multus/multus-hs4wq" Jul 21 14:17:55.450361 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.450117 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10-etc-systemd\") pod \"tuned-pnsb2\" (UID: \"f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10\") " pod="openshift-cluster-node-tuning-operator/tuned-pnsb2" Jul 21 14:17:55.450361 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.450180 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ad32aaa-9b75-431d-b467-6e3e01db7864-host-var-lib-kubelet\") pod \"multus-hs4wq\" (UID: \"6ad32aaa-9b75-431d-b467-6e3e01db7864\") " pod="openshift-multus/multus-hs4wq" Jul 21 14:17:55.450361 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.450246 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ad32aaa-9b75-431d-b467-6e3e01db7864-host-var-lib-kubelet\") pod \"multus-hs4wq\" (UID: \"6ad32aaa-9b75-431d-b467-6e3e01db7864\") " pod="openshift-multus/multus-hs4wq" Jul 21 14:17:55.450361 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.450246 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6ad32aaa-9b75-431d-b467-6e3e01db7864-host-var-lib-cni-multus\") pod \"multus-hs4wq\" (UID: \"6ad32aaa-9b75-431d-b467-6e3e01db7864\") " pod="openshift-multus/multus-hs4wq" Jul 21 14:17:55.451085 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.450285 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c22b3b26-5ab0-4206-aee9-9f10dbe890a1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vhrsj\" (UID: \"c22b3b26-5ab0-4206-aee9-9f10dbe890a1\") " pod="openshift-multus/multus-additional-cni-plugins-vhrsj" Jul 21 14:17:55.451085 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.450338 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6ad32aaa-9b75-431d-b467-6e3e01db7864-host-run-multus-certs\") pod \"multus-hs4wq\" (UID: \"6ad32aaa-9b75-431d-b467-6e3e01db7864\") " pod="openshift-multus/multus-hs4wq" Jul 21 14:17:55.451085 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.450316 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6ad32aaa-9b75-431d-b467-6e3e01db7864-host-run-multus-certs\") pod \"multus-hs4wq\" (UID: \"6ad32aaa-9b75-431d-b467-6e3e01db7864\") " pod="openshift-multus/multus-hs4wq" Jul 21 14:17:55.451085 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.450396 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/10f6f6de-8f81-4811-9798-9bec360e01f7-var-lib-openvswitch\") pod \"ovnkube-node-c4p99\" (UID: \"10f6f6de-8f81-4811-9798-9bec360e01f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4p99" Jul 21 14:17:55.451085 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.450421 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/10f6f6de-8f81-4811-9798-9bec360e01f7-host-run-ovn-kubernetes\") pod \"ovnkube-node-c4p99\" (UID: \"10f6f6de-8f81-4811-9798-9bec360e01f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4p99" Jul 21 14:17:55.451085 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.450454 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/10f6f6de-8f81-4811-9798-9bec360e01f7-var-lib-openvswitch\") pod \"ovnkube-node-c4p99\" (UID: \"10f6f6de-8f81-4811-9798-9bec360e01f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4p99" Jul 21 14:17:55.451085 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.450467 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/10f6f6de-8f81-4811-9798-9bec360e01f7-host-run-ovn-kubernetes\") pod \"ovnkube-node-c4p99\" (UID: \"10f6f6de-8f81-4811-9798-9bec360e01f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4p99" Jul 21 14:17:55.451085 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.450456 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkfq2\" (UniqueName: \"kubernetes.io/projected/f208bc8d-9c6c-4dc0-a7e3-a95c9e26c3d6-kube-api-access-pkfq2\") pod \"network-metrics-daemon-9tpq5\" (UID: \"f208bc8d-9c6c-4dc0-a7e3-a95c9e26c3d6\") " pod="openshift-multus/network-metrics-daemon-9tpq5" Jul 21 14:17:55.451085 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.450507 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10-lib-modules\") pod \"tuned-pnsb2\" (UID: \"f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10\") " pod="openshift-cluster-node-tuning-operator/tuned-pnsb2" Jul 21 14:17:55.451085 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.450530 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10-tmp\") pod \"tuned-pnsb2\" (UID: \"f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10\") " pod="openshift-cluster-node-tuning-operator/tuned-pnsb2" Jul 21 14:17:55.451085 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.450549 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9c59\" (UniqueName: \"kubernetes.io/projected/f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10-kube-api-access-t9c59\") pod \"tuned-pnsb2\" (UID: \"f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10\") " pod="openshift-cluster-node-tuning-operator/tuned-pnsb2" Jul 21 14:17:55.451085 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.450586 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08737a2e-4e32-441c-b905-c2a2e41b1d17-tmp-dir\") pod \"node-resolver-b5kkg\" (UID: \"08737a2e-4e32-441c-b905-c2a2e41b1d17\") " pod="openshift-dns/node-resolver-b5kkg" Jul 21 14:17:55.451085 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.450571 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6ab945a0-5e72-4852-8a76-462020ef4af6-kubelet-config\") pod \"global-pull-secret-syncer-4r4d6\" (UID: \"6ab945a0-5e72-4852-8a76-462020ef4af6\") " pod="kube-system/global-pull-secret-syncer-4r4d6" Jul 21 14:17:55.451085 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.450709 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10-etc-modprobe-d\") pod \"tuned-pnsb2\" (UID: \"f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10\") " pod="openshift-cluster-node-tuning-operator/tuned-pnsb2" Jul 21 14:17:55.451085 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.450731 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10-lib-modules\") pod \"tuned-pnsb2\" (UID: \"f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10\") " pod="openshift-cluster-node-tuning-operator/tuned-pnsb2" Jul 21 14:17:55.451085 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.450738 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/10f6f6de-8f81-4811-9798-9bec360e01f7-ovnkube-script-lib\") pod \"ovnkube-node-c4p99\" (UID: \"10f6f6de-8f81-4811-9798-9bec360e01f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4p99" Jul 21 14:17:55.451085 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.450809 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/10f6f6de-8f81-4811-9798-9bec360e01f7-host-kubelet\") pod \"ovnkube-node-c4p99\" (UID: \"10f6f6de-8f81-4811-9798-9bec360e01f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4p99" Jul 21 14:17:55.451937 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.450834 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6ad32aaa-9b75-431d-b467-6e3e01db7864-host-run-netns\") pod \"multus-hs4wq\" (UID: \"6ad32aaa-9b75-431d-b467-6e3e01db7864\") " pod="openshift-multus/multus-hs4wq" Jul 21 14:17:55.451937 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.450863 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/08737a2e-4e32-441c-b905-c2a2e41b1d17-hosts-file\") pod \"node-resolver-b5kkg\" (UID: \"08737a2e-4e32-441c-b905-c2a2e41b1d17\") " pod="openshift-dns/node-resolver-b5kkg" Jul 21 14:17:55.451937 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.450864 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10-etc-modprobe-d\") pod \"tuned-pnsb2\" (UID: \"f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10\") " pod="openshift-cluster-node-tuning-operator/tuned-pnsb2" Jul 21 14:17:55.451937 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.450920 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6ad32aaa-9b75-431d-b467-6e3e01db7864-host-run-netns\") pod \"multus-hs4wq\" (UID: \"6ad32aaa-9b75-431d-b467-6e3e01db7864\") " pod="openshift-multus/multus-hs4wq" Jul 21 14:17:55.451937 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.450934 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/08737a2e-4e32-441c-b905-c2a2e41b1d17-hosts-file\") pod \"node-resolver-b5kkg\" (UID: \"08737a2e-4e32-441c-b905-c2a2e41b1d17\") " pod="openshift-dns/node-resolver-b5kkg" Jul 21 14:17:55.451937 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.450962 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ad32aaa-9b75-431d-b467-6e3e01db7864-etc-kubernetes\") pod \"multus-hs4wq\" (UID: \"6ad32aaa-9b75-431d-b467-6e3e01db7864\") " pod="openshift-multus/multus-hs4wq" Jul 21 14:17:55.451937 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.450946 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/10f6f6de-8f81-4811-9798-9bec360e01f7-host-kubelet\") pod \"ovnkube-node-c4p99\" (UID: \"10f6f6de-8f81-4811-9798-9bec360e01f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4p99" Jul 21 14:17:55.451937 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.451023 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ad32aaa-9b75-431d-b467-6e3e01db7864-etc-kubernetes\") pod \"multus-hs4wq\" (UID: \"6ad32aaa-9b75-431d-b467-6e3e01db7864\") " pod="openshift-multus/multus-hs4wq" Jul 21 14:17:55.451937 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.451026 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6ab945a0-5e72-4852-8a76-462020ef4af6-original-pull-secret\") pod \"global-pull-secret-syncer-4r4d6\" (UID: \"6ab945a0-5e72-4852-8a76-462020ef4af6\") " pod="kube-system/global-pull-secret-syncer-4r4d6" Jul 21 14:17:55.451937 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.451074 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clhjq\" (UniqueName: \"kubernetes.io/projected/8ccfca56-0054-4006-be8c-2fb53147addd-kube-api-access-clhjq\") pod \"node-ca-nxm5s\" (UID: \"8ccfca56-0054-4006-be8c-2fb53147addd\") " pod="openshift-image-registry/node-ca-nxm5s" Jul 21 14:17:55.451937 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.450986 2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 21 14:17:55.451937 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.451153 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/10f6f6de-8f81-4811-9798-9bec360e01f7-node-log\") pod \"ovnkube-node-c4p99\" (UID: \"10f6f6de-8f81-4811-9798-9bec360e01f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4p99" Jul 21 14:17:55.451937 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.451117 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/10f6f6de-8f81-4811-9798-9bec360e01f7-node-log\") pod \"ovnkube-node-c4p99\" (UID: \"10f6f6de-8f81-4811-9798-9bec360e01f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4p99" Jul 21 14:17:55.451937 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.451211 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/10f6f6de-8f81-4811-9798-9bec360e01f7-ovnkube-config\") pod \"ovnkube-node-c4p99\" (UID: \"10f6f6de-8f81-4811-9798-9bec360e01f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4p99" Jul 21 14:17:55.451937 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.451247 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7d09a08b-bf2f-43b1-8ab2-91176c9db0db-device-dir\") pod \"aws-ebs-csi-driver-node-zjfwt\" (UID: \"7d09a08b-bf2f-43b1-8ab2-91176c9db0db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjfwt" Jul 21 14:17:55.451937 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.451298 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6ad32aaa-9b75-431d-b467-6e3e01db7864-hostroot\") pod \"multus-hs4wq\" (UID: \"6ad32aaa-9b75-431d-b467-6e3e01db7864\") " pod="openshift-multus/multus-hs4wq" Jul 21 14:17:55.451937 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.451357 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/10f6f6de-8f81-4811-9798-9bec360e01f7-host-run-netns\") pod \"ovnkube-node-c4p99\" (UID: \"10f6f6de-8f81-4811-9798-9bec360e01f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4p99" Jul 21 14:17:55.451937 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.451387 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/10f6f6de-8f81-4811-9798-9bec360e01f7-run-systemd\") pod \"ovnkube-node-c4p99\" (UID: \"10f6f6de-8f81-4811-9798-9bec360e01f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4p99" Jul 21 14:17:55.452900 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.451425 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/10f6f6de-8f81-4811-9798-9bec360e01f7-run-openvswitch\") pod \"ovnkube-node-c4p99\" (UID: \"10f6f6de-8f81-4811-9798-9bec360e01f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4p99" Jul 21 14:17:55.452900 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.451497 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/10f6f6de-8f81-4811-9798-9bec360e01f7-host-cni-netd\") pod \"ovnkube-node-c4p99\" (UID: \"10f6f6de-8f81-4811-9798-9bec360e01f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4p99" Jul 21 14:17:55.452900 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.451531 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10-etc-sysconfig\") pod \"tuned-pnsb2\" (UID: \"f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10\") " pod="openshift-cluster-node-tuning-operator/tuned-pnsb2" Jul 21 14:17:55.452900 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.451564 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10-etc-sysctl-conf\") pod \"tuned-pnsb2\" (UID: \"f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10\") " pod="openshift-cluster-node-tuning-operator/tuned-pnsb2" Jul 21 14:17:55.452900 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.451594 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10-etc-tuned\") pod \"tuned-pnsb2\" (UID: \"f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10\") " pod="openshift-cluster-node-tuning-operator/tuned-pnsb2" Jul 21 14:17:55.452900 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.451658 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/10f6f6de-8f81-4811-9798-9bec360e01f7-run-systemd\") pod \"ovnkube-node-c4p99\" (UID: \"10f6f6de-8f81-4811-9798-9bec360e01f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4p99" Jul 21 14:17:55.452900 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.451681 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6ad32aaa-9b75-431d-b467-6e3e01db7864-multus-cni-dir\") pod \"multus-hs4wq\" (UID: \"6ad32aaa-9b75-431d-b467-6e3e01db7864\") " pod="openshift-multus/multus-hs4wq" Jul 21 14:17:55.452900 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.451742 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/10f6f6de-8f81-4811-9798-9bec360e01f7-ovnkube-script-lib\") pod \"ovnkube-node-c4p99\" (UID: \"10f6f6de-8f81-4811-9798-9bec360e01f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4p99" Jul 21 14:17:55.452900 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.451764 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/32d461fa-ba21-427d-b9de-24cceea9e7c1-konnectivity-ca\") pod \"konnectivity-agent-gfgt6\" (UID: \"32d461fa-ba21-427d-b9de-24cceea9e7c1\") " pod="kube-system/konnectivity-agent-gfgt6" Jul 21 14:17:55.452900 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.451797 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10-etc-sysctl-d\") pod \"tuned-pnsb2\" (UID: \"f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10\") " pod="openshift-cluster-node-tuning-operator/tuned-pnsb2" Jul 21 14:17:55.452900 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.451865 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6ad32aaa-9b75-431d-b467-6e3e01db7864-hostroot\") pod \"multus-hs4wq\" (UID: \"6ad32aaa-9b75-431d-b467-6e3e01db7864\") " pod="openshift-multus/multus-hs4wq" Jul 21 14:17:55.452900 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.451835 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8r54v\" (UniqueName: \"kubernetes.io/projected/08737a2e-4e32-441c-b905-c2a2e41b1d17-kube-api-access-8r54v\") pod \"node-resolver-b5kkg\" (UID: \"08737a2e-4e32-441c-b905-c2a2e41b1d17\") " pod="openshift-dns/node-resolver-b5kkg" Jul 21 14:17:55.452900 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.451929 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6ad32aaa-9b75-431d-b467-6e3e01db7864-multus-daemon-config\") pod \"multus-hs4wq\" (UID: \"6ad32aaa-9b75-431d-b467-6e3e01db7864\") " pod="openshift-multus/multus-hs4wq" Jul 21 14:17:55.452900 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.451988 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6ab945a0-5e72-4852-8a76-462020ef4af6-dbus\") pod \"global-pull-secret-syncer-4r4d6\" (UID: \"6ab945a0-5e72-4852-8a76-462020ef4af6\") " pod="kube-system/global-pull-secret-syncer-4r4d6" Jul 21 14:17:55.452900 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.452027 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/10f6f6de-8f81-4811-9798-9bec360e01f7-ovnkube-config\") pod \"ovnkube-node-c4p99\" (UID: \"10f6f6de-8f81-4811-9798-9bec360e01f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4p99" Jul 21 14:17:55.452900 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.452036 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/10f6f6de-8f81-4811-9798-9bec360e01f7-log-socket\") pod \"ovnkube-node-c4p99\" (UID: \"10f6f6de-8f81-4811-9798-9bec360e01f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4p99" Jul 21 14:17:55.452900 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.452092 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6ad32aaa-9b75-431d-b467-6e3e01db7864-multus-cni-dir\") pod \"multus-hs4wq\" (UID: \"6ad32aaa-9b75-431d-b467-6e3e01db7864\") " pod="openshift-multus/multus-hs4wq" Jul 21 14:17:55.452900 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.452119 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7d09a08b-bf2f-43b1-8ab2-91176c9db0db-sys-fs\") pod \"aws-ebs-csi-driver-node-zjfwt\" (UID: \"7d09a08b-bf2f-43b1-8ab2-91176c9db0db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjfwt" Jul 21 14:17:55.453768 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.452098 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/10f6f6de-8f81-4811-9798-9bec360e01f7-host-cni-netd\") pod \"ovnkube-node-c4p99\" (UID: \"10f6f6de-8f81-4811-9798-9bec360e01f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4p99" Jul 21 14:17:55.453768 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.452185 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10-etc-sysconfig\") pod \"tuned-pnsb2\" (UID: \"f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10\") " pod="openshift-cluster-node-tuning-operator/tuned-pnsb2" Jul 21 14:17:55.453768 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.452195 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c22b3b26-5ab0-4206-aee9-9f10dbe890a1-os-release\") pod \"multus-additional-cni-plugins-vhrsj\" (UID: \"c22b3b26-5ab0-4206-aee9-9f10dbe890a1\") " pod="openshift-multus/multus-additional-cni-plugins-vhrsj" Jul 21 14:17:55.453768 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.452195 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/10f6f6de-8f81-4811-9798-9bec360e01f7-run-openvswitch\") pod \"ovnkube-node-c4p99\" (UID: \"10f6f6de-8f81-4811-9798-9bec360e01f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4p99" Jul 21 14:17:55.453768 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.452246 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c22b3b26-5ab0-4206-aee9-9f10dbe890a1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vhrsj\" (UID: \"c22b3b26-5ab0-4206-aee9-9f10dbe890a1\") " pod="openshift-multus/multus-additional-cni-plugins-vhrsj" Jul 21 14:17:55.453768 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.452278 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6ad32aaa-9b75-431d-b467-6e3e01db7864-os-release\") pod \"multus-hs4wq\" (UID: \"6ad32aaa-9b75-431d-b467-6e3e01db7864\") " pod="openshift-multus/multus-hs4wq" Jul 21 14:17:55.453768 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.452329 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c22b3b26-5ab0-4206-aee9-9f10dbe890a1-os-release\") pod \"multus-additional-cni-plugins-vhrsj\" (UID: \"c22b3b26-5ab0-4206-aee9-9f10dbe890a1\") " pod="openshift-multus/multus-additional-cni-plugins-vhrsj" Jul 21 14:17:55.453768 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.451889 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/10f6f6de-8f81-4811-9798-9bec360e01f7-host-run-netns\") pod \"ovnkube-node-c4p99\" (UID: \"10f6f6de-8f81-4811-9798-9bec360e01f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4p99" Jul 21 14:17:55.453768 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.452368 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4d2e67d2-585f-46a1-9bff-fd6583e1d6f2-iptables-alerter-script\") pod \"iptables-alerter-2ct2w\" (UID: \"4d2e67d2-585f-46a1-9bff-fd6583e1d6f2\") " pod="openshift-network-operator/iptables-alerter-2ct2w" Jul 21 14:17:55.453768 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.452403 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/10f6f6de-8f81-4811-9798-9bec360e01f7-env-overrides\") pod \"ovnkube-node-c4p99\" (UID: \"10f6f6de-8f81-4811-9798-9bec360e01f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4p99" Jul 21 14:17:55.453768 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.452469 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10-run\") pod \"tuned-pnsb2\" (UID: \"f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10\") " pod="openshift-cluster-node-tuning-operator/tuned-pnsb2" Jul 21 14:17:55.453768 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.452529 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6ad32aaa-9b75-431d-b467-6e3e01db7864-host-var-lib-cni-bin\") pod \"multus-hs4wq\" (UID: \"6ad32aaa-9b75-431d-b467-6e3e01db7864\") " pod="openshift-multus/multus-hs4wq" Jul 21 14:17:55.453768 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.452585 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4d2e67d2-585f-46a1-9bff-fd6583e1d6f2-host-slash\") pod \"iptables-alerter-2ct2w\" (UID: \"4d2e67d2-585f-46a1-9bff-fd6583e1d6f2\") " pod="openshift-network-operator/iptables-alerter-2ct2w" Jul 21 14:17:55.453768 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.452655 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7d09a08b-bf2f-43b1-8ab2-91176c9db0db-etc-selinux\") pod \"aws-ebs-csi-driver-node-zjfwt\" (UID: \"7d09a08b-bf2f-43b1-8ab2-91176c9db0db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjfwt" Jul 21 14:17:55.453768 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.452694 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f208bc8d-9c6c-4dc0-a7e3-a95c9e26c3d6-metrics-certs\") pod \"network-metrics-daemon-9tpq5\" (UID: \"f208bc8d-9c6c-4dc0-a7e3-a95c9e26c3d6\") " pod="openshift-multus/network-metrics-daemon-9tpq5" Jul 21 14:17:55.453768 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.452752 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/10f6f6de-8f81-4811-9798-9bec360e01f7-ovn-node-metrics-cert\") pod \"ovnkube-node-c4p99\" (UID: \"10f6f6de-8f81-4811-9798-9bec360e01f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4p99" Jul 21 14:17:55.453768 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.452791 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8ccfca56-0054-4006-be8c-2fb53147addd-host\") pod \"node-ca-nxm5s\" (UID: \"8ccfca56-0054-4006-be8c-2fb53147addd\") " pod="openshift-image-registry/node-ca-nxm5s" Jul 21 14:17:55.454727 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.451738 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7d09a08b-bf2f-43b1-8ab2-91176c9db0db-device-dir\") pod \"aws-ebs-csi-driver-node-zjfwt\" (UID: \"7d09a08b-bf2f-43b1-8ab2-91176c9db0db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjfwt" Jul 21 14:17:55.454727 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.452848 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/10f6f6de-8f81-4811-9798-9bec360e01f7-host-slash\") pod \"ovnkube-node-c4p99\" (UID: \"10f6f6de-8f81-4811-9798-9bec360e01f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4p99" Jul 21 14:17:55.454727 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.452906 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/10f6f6de-8f81-4811-9798-9bec360e01f7-run-ovn\") pod \"ovnkube-node-c4p99\" (UID: \"10f6f6de-8f81-4811-9798-9bec360e01f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4p99" Jul 21 14:17:55.454727 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.452939 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7d09a08b-bf2f-43b1-8ab2-91176c9db0db-registration-dir\") pod \"aws-ebs-csi-driver-node-zjfwt\" (UID: \"7d09a08b-bf2f-43b1-8ab2-91176c9db0db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjfwt" Jul 21 14:17:55.454727 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.452973 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c22b3b26-5ab0-4206-aee9-9f10dbe890a1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vhrsj\" (UID: \"c22b3b26-5ab0-4206-aee9-9f10dbe890a1\") " pod="openshift-multus/multus-additional-cni-plugins-vhrsj" Jul 21 14:17:55.454727 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.453071 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/32d461fa-ba21-427d-b9de-24cceea9e7c1-agent-certs\") pod \"konnectivity-agent-gfgt6\" (UID: \"32d461fa-ba21-427d-b9de-24cceea9e7c1\") " pod="kube-system/konnectivity-agent-gfgt6" Jul 21 14:17:55.454727 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.453186 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10-var-lib-kubelet\") pod \"tuned-pnsb2\" (UID: \"f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10\") " pod="openshift-cluster-node-tuning-operator/tuned-pnsb2" Jul 21 14:17:55.454727 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.453196 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/32d461fa-ba21-427d-b9de-24cceea9e7c1-konnectivity-ca\") pod \"konnectivity-agent-gfgt6\" (UID: \"32d461fa-ba21-427d-b9de-24cceea9e7c1\") " pod="kube-system/konnectivity-agent-gfgt6" Jul 21 14:17:55.454727 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.453227 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6ad32aaa-9b75-431d-b467-6e3e01db7864-cnibin\") pod \"multus-hs4wq\" (UID: \"6ad32aaa-9b75-431d-b467-6e3e01db7864\") " pod="openshift-multus/multus-hs4wq" Jul 21 14:17:55.454727 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.453286 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrb74\" (UniqueName: \"kubernetes.io/projected/9d5c37aa-d496-4010-942a-92ead7dfa6b1-kube-api-access-wrb74\") pod \"network-check-target-fttn7\" (UID: \"9d5c37aa-d496-4010-942a-92ead7dfa6b1\") " pod="openshift-network-diagnostics/network-check-target-fttn7" Jul 21 14:17:55.454727 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.453332 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10-host\") pod \"tuned-pnsb2\" (UID: \"f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10\") " pod="openshift-cluster-node-tuning-operator/tuned-pnsb2" Jul 21 14:17:55.454727 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.453375 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10-etc-sysctl-d\") pod \"tuned-pnsb2\" (UID: \"f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10\") " pod="openshift-cluster-node-tuning-operator/tuned-pnsb2" Jul 21 14:17:55.454727 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.453466 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10-etc-sysctl-conf\") pod \"tuned-pnsb2\" (UID: \"f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10\") " pod="openshift-cluster-node-tuning-operator/tuned-pnsb2" Jul 21 14:17:55.454727 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.453472 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/10f6f6de-8f81-4811-9798-9bec360e01f7-log-socket\") pod \"ovnkube-node-c4p99\" (UID: \"10f6f6de-8f81-4811-9798-9bec360e01f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4p99" Jul 21 14:17:55.454727 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.453584 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/10f6f6de-8f81-4811-9798-9bec360e01f7-host-slash\") pod \"ovnkube-node-c4p99\" (UID: \"10f6f6de-8f81-4811-9798-9bec360e01f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4p99" Jul 21 14:17:55.454727 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.453584 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6ad32aaa-9b75-431d-b467-6e3e01db7864-cnibin\") pod \"multus-hs4wq\" (UID: \"6ad32aaa-9b75-431d-b467-6e3e01db7864\") " pod="openshift-multus/multus-hs4wq" Jul 21 14:17:55.454727 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.453647 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6ad32aaa-9b75-431d-b467-6e3e01db7864-multus-daemon-config\") pod \"multus-hs4wq\" (UID: \"6ad32aaa-9b75-431d-b467-6e3e01db7864\") " pod="openshift-multus/multus-hs4wq" Jul 21 14:17:55.454727 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.453720 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7d09a08b-bf2f-43b1-8ab2-91176c9db0db-sys-fs\") pod \"aws-ebs-csi-driver-node-zjfwt\" (UID: \"7d09a08b-bf2f-43b1-8ab2-91176c9db0db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjfwt" Jul 21 14:17:55.455688 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.453710 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10-host\") pod \"tuned-pnsb2\" (UID: \"f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10\") " pod="openshift-cluster-node-tuning-operator/tuned-pnsb2" Jul 21 14:17:55.455688 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.453770 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10-run\") pod \"tuned-pnsb2\" (UID: \"f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10\") " pod="openshift-cluster-node-tuning-operator/tuned-pnsb2" Jul 21 14:17:55.455688 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.453804 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6ad32aaa-9b75-431d-b467-6e3e01db7864-host-var-lib-cni-bin\") pod \"multus-hs4wq\" (UID: \"6ad32aaa-9b75-431d-b467-6e3e01db7864\") " pod="openshift-multus/multus-hs4wq" Jul 21 14:17:55.455688 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.453886 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7d09a08b-bf2f-43b1-8ab2-91176c9db0db-etc-selinux\") pod \"aws-ebs-csi-driver-node-zjfwt\" (UID: \"7d09a08b-bf2f-43b1-8ab2-91176c9db0db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjfwt" Jul 21 14:17:55.455688 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.453902 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7d09a08b-bf2f-43b1-8ab2-91176c9db0db-registration-dir\") pod \"aws-ebs-csi-driver-node-zjfwt\" (UID: \"7d09a08b-bf2f-43b1-8ab2-91176c9db0db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjfwt" Jul 21 14:17:55.455688 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.453969 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10-var-lib-kubelet\") pod \"tuned-pnsb2\" (UID: \"f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10\") " pod="openshift-cluster-node-tuning-operator/tuned-pnsb2" Jul 21 14:17:55.455688 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:17:55.454004 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 14:17:55.455688 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.454019 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8ccfca56-0054-4006-be8c-2fb53147addd-host\") pod \"node-ca-nxm5s\" (UID: \"8ccfca56-0054-4006-be8c-2fb53147addd\") " pod="openshift-image-registry/node-ca-nxm5s" Jul 21 14:17:55.455688 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.454062 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/10f6f6de-8f81-4811-9798-9bec360e01f7-run-ovn\") pod \"ovnkube-node-c4p99\" (UID: \"10f6f6de-8f81-4811-9798-9bec360e01f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4p99" Jul 21 14:17:55.455688 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.454074 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6ad32aaa-9b75-431d-b467-6e3e01db7864-os-release\") pod \"multus-hs4wq\" (UID: \"6ad32aaa-9b75-431d-b467-6e3e01db7864\") " pod="openshift-multus/multus-hs4wq" Jul 21 14:17:55.455688 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:17:55.454263 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f208bc8d-9c6c-4dc0-a7e3-a95c9e26c3d6-metrics-certs podName:f208bc8d-9c6c-4dc0-a7e3-a95c9e26c3d6 nodeName:}" failed. No retries permitted until 2026-07-21 14:17:55.954219442 +0000 UTC m=+2.972123001 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f208bc8d-9c6c-4dc0-a7e3-a95c9e26c3d6-metrics-certs") pod "network-metrics-daemon-9tpq5" (UID: "f208bc8d-9c6c-4dc0-a7e3-a95c9e26c3d6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 14:17:55.455688 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.454233 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c22b3b26-5ab0-4206-aee9-9f10dbe890a1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vhrsj\" (UID: \"c22b3b26-5ab0-4206-aee9-9f10dbe890a1\") " pod="openshift-multus/multus-additional-cni-plugins-vhrsj" Jul 21 14:17:55.455688 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.454517 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c22b3b26-5ab0-4206-aee9-9f10dbe890a1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vhrsj\" (UID: \"c22b3b26-5ab0-4206-aee9-9f10dbe890a1\") " pod="openshift-multus/multus-additional-cni-plugins-vhrsj" Jul 21 14:17:55.455688 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.455601 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/10f6f6de-8f81-4811-9798-9bec360e01f7-env-overrides\") pod \"ovnkube-node-c4p99\" (UID: \"10f6f6de-8f81-4811-9798-9bec360e01f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4p99" Jul 21 14:17:55.456534 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.456088 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10-etc-tuned\") pod \"tuned-pnsb2\" (UID: \"f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10\") " pod="openshift-cluster-node-tuning-operator/tuned-pnsb2" Jul 21 14:17:55.456534 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.456180 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10-tmp\") pod \"tuned-pnsb2\" (UID: \"f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10\") " pod="openshift-cluster-node-tuning-operator/tuned-pnsb2" Jul 21 14:17:55.456534 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.456514 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/10f6f6de-8f81-4811-9798-9bec360e01f7-ovn-node-metrics-cert\") pod \"ovnkube-node-c4p99\" (UID: \"10f6f6de-8f81-4811-9798-9bec360e01f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4p99" Jul 21 14:17:55.457017 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.456996 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/32d461fa-ba21-427d-b9de-24cceea9e7c1-agent-certs\") pod \"konnectivity-agent-gfgt6\" (UID: \"32d461fa-ba21-427d-b9de-24cceea9e7c1\") " pod="kube-system/konnectivity-agent-gfgt6" Jul 21 14:17:55.461489 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.461197 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qlbz\" (UniqueName: \"kubernetes.io/projected/6ad32aaa-9b75-431d-b467-6e3e01db7864-kube-api-access-7qlbz\") pod \"multus-hs4wq\" (UID: \"6ad32aaa-9b75-431d-b467-6e3e01db7864\") " pod="openshift-multus/multus-hs4wq" Jul 21 14:17:55.461489 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.461405 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkfq2\" (UniqueName: \"kubernetes.io/projected/f208bc8d-9c6c-4dc0-a7e3-a95c9e26c3d6-kube-api-access-pkfq2\") pod \"network-metrics-daemon-9tpq5\" (UID: \"f208bc8d-9c6c-4dc0-a7e3-a95c9e26c3d6\") " pod="openshift-multus/network-metrics-daemon-9tpq5" Jul 21 14:17:55.461489 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.461470 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9c59\" (UniqueName: \"kubernetes.io/projected/f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10-kube-api-access-t9c59\") pod \"tuned-pnsb2\" (UID: \"f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10\") " pod="openshift-cluster-node-tuning-operator/tuned-pnsb2" Jul 21 14:17:55.461489 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.461484 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fhs8\" (UniqueName: \"kubernetes.io/projected/10f6f6de-8f81-4811-9798-9bec360e01f7-kube-api-access-7fhs8\") pod \"ovnkube-node-c4p99\" (UID: \"10f6f6de-8f81-4811-9798-9bec360e01f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4p99" Jul 21 14:17:55.462937 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.462105 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bx6h7\" (UniqueName: \"kubernetes.io/projected/7d09a08b-bf2f-43b1-8ab2-91176c9db0db-kube-api-access-bx6h7\") pod \"aws-ebs-csi-driver-node-zjfwt\" (UID: \"7d09a08b-bf2f-43b1-8ab2-91176c9db0db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjfwt" Jul 21 14:17:55.464962 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:17:55.463120 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 14:17:55.464962 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:17:55.463153 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 14:17:55.464962 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:17:55.463170 2576 projected.go:196] Error preparing data for projected volume kube-api-access-wrb74 for pod openshift-network-diagnostics/network-check-target-fttn7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 14:17:55.464962 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:17:55.463287 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d5c37aa-d496-4010-942a-92ead7dfa6b1-kube-api-access-wrb74 podName:9d5c37aa-d496-4010-942a-92ead7dfa6b1 nodeName:}" failed. No retries permitted until 2026-07-21 14:17:55.963254708 +0000 UTC m=+2.981158278 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-wrb74" (UniqueName: "kubernetes.io/projected/9d5c37aa-d496-4010-942a-92ead7dfa6b1-kube-api-access-wrb74") pod "network-check-target-fttn7" (UID: "9d5c37aa-d496-4010-942a-92ead7dfa6b1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 14:17:55.464962 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.464457 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmkh5\" (UniqueName: \"kubernetes.io/projected/c22b3b26-5ab0-4206-aee9-9f10dbe890a1-kube-api-access-wmkh5\") pod \"multus-additional-cni-plugins-vhrsj\" (UID: \"c22b3b26-5ab0-4206-aee9-9f10dbe890a1\") " pod="openshift-multus/multus-additional-cni-plugins-vhrsj" Jul 21 14:17:55.464962 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.464783 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-clhjq\" (UniqueName: \"kubernetes.io/projected/8ccfca56-0054-4006-be8c-2fb53147addd-kube-api-access-clhjq\") pod \"node-ca-nxm5s\" (UID: \"8ccfca56-0054-4006-be8c-2fb53147addd\") " pod="openshift-image-registry/node-ca-nxm5s" Jul 21 14:17:55.468399 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.468363 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8r54v\" (UniqueName: \"kubernetes.io/projected/08737a2e-4e32-441c-b905-c2a2e41b1d17-kube-api-access-8r54v\") pod \"node-resolver-b5kkg\" (UID: \"08737a2e-4e32-441c-b905-c2a2e41b1d17\") " pod="openshift-dns/node-resolver-b5kkg" Jul 21 14:17:55.524512 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.524454 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-199.ec2.internal" event={"ID":"d39c96e45fa97134bd3353fcd622d146","Type":"ContainerStarted","Data":"d3173a6132f464b22ca674724fc82a621d22cb0a399ee22b22a251eed099b4a1"} Jul 21 14:17:55.554124 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.553991 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5g5k\" (UniqueName: \"kubernetes.io/projected/4d2e67d2-585f-46a1-9bff-fd6583e1d6f2-kube-api-access-c5g5k\") pod \"iptables-alerter-2ct2w\" (UID: \"4d2e67d2-585f-46a1-9bff-fd6583e1d6f2\") " pod="openshift-network-operator/iptables-alerter-2ct2w" Jul 21 14:17:55.554124 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.554060 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6ab945a0-5e72-4852-8a76-462020ef4af6-kubelet-config\") pod \"global-pull-secret-syncer-4r4d6\" (UID: \"6ab945a0-5e72-4852-8a76-462020ef4af6\") " pod="kube-system/global-pull-secret-syncer-4r4d6" Jul 21 14:17:55.554124 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.554084 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6ab945a0-5e72-4852-8a76-462020ef4af6-original-pull-secret\") pod \"global-pull-secret-syncer-4r4d6\" (UID: \"6ab945a0-5e72-4852-8a76-462020ef4af6\") " pod="kube-system/global-pull-secret-syncer-4r4d6" Jul 21 14:17:55.554124 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.554110 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6ab945a0-5e72-4852-8a76-462020ef4af6-dbus\") pod \"global-pull-secret-syncer-4r4d6\" (UID: \"6ab945a0-5e72-4852-8a76-462020ef4af6\") " pod="kube-system/global-pull-secret-syncer-4r4d6" Jul 21 14:17:55.554489 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.554133 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4d2e67d2-585f-46a1-9bff-fd6583e1d6f2-iptables-alerter-script\") pod \"iptables-alerter-2ct2w\" (UID: \"4d2e67d2-585f-46a1-9bff-fd6583e1d6f2\") " pod="openshift-network-operator/iptables-alerter-2ct2w" Jul 21 14:17:55.554489 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.554153 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4d2e67d2-585f-46a1-9bff-fd6583e1d6f2-host-slash\") pod \"iptables-alerter-2ct2w\" (UID: \"4d2e67d2-585f-46a1-9bff-fd6583e1d6f2\") " pod="openshift-network-operator/iptables-alerter-2ct2w" Jul 21 14:17:55.554489 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.554257 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6ab945a0-5e72-4852-8a76-462020ef4af6-kubelet-config\") pod \"global-pull-secret-syncer-4r4d6\" (UID: \"6ab945a0-5e72-4852-8a76-462020ef4af6\") " pod="kube-system/global-pull-secret-syncer-4r4d6" Jul 21 14:17:55.554489 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:17:55.554296 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 14:17:55.554489 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.554319 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4d2e67d2-585f-46a1-9bff-fd6583e1d6f2-host-slash\") pod \"iptables-alerter-2ct2w\" (UID: \"4d2e67d2-585f-46a1-9bff-fd6583e1d6f2\") " pod="openshift-network-operator/iptables-alerter-2ct2w" Jul 21 14:17:55.554489 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:17:55.554377 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ab945a0-5e72-4852-8a76-462020ef4af6-original-pull-secret podName:6ab945a0-5e72-4852-8a76-462020ef4af6 nodeName:}" failed. No retries permitted until 2026-07-21 14:17:56.054351579 +0000 UTC m=+3.072255153 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6ab945a0-5e72-4852-8a76-462020ef4af6-original-pull-secret") pod "global-pull-secret-syncer-4r4d6" (UID: "6ab945a0-5e72-4852-8a76-462020ef4af6") : object "kube-system"/"original-pull-secret" not registered Jul 21 14:17:55.554489 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.554384 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6ab945a0-5e72-4852-8a76-462020ef4af6-dbus\") pod \"global-pull-secret-syncer-4r4d6\" (UID: \"6ab945a0-5e72-4852-8a76-462020ef4af6\") " pod="kube-system/global-pull-secret-syncer-4r4d6" Jul 21 14:17:55.554940 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.554918 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4d2e67d2-585f-46a1-9bff-fd6583e1d6f2-iptables-alerter-script\") pod \"iptables-alerter-2ct2w\" (UID: \"4d2e67d2-585f-46a1-9bff-fd6583e1d6f2\") " pod="openshift-network-operator/iptables-alerter-2ct2w" Jul 21 14:17:55.565245 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.565199 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5g5k\" (UniqueName: \"kubernetes.io/projected/4d2e67d2-585f-46a1-9bff-fd6583e1d6f2-kube-api-access-c5g5k\") pod \"iptables-alerter-2ct2w\" (UID: \"4d2e67d2-585f-46a1-9bff-fd6583e1d6f2\") " pod="openshift-network-operator/iptables-alerter-2ct2w" Jul 21 14:17:55.630358 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.630289 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hs4wq" Jul 21 14:17:55.640221 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.640184 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nxm5s" Jul 21 14:17:55.643065 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:55.643022 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ad32aaa_9b75_431d_b467_6e3e01db7864.slice/crio-ad61fbf046979b3d97a70798b8f76b74c80ee6a529750b63e7e43819b49d50cf WatchSource:0}: Error finding container ad61fbf046979b3d97a70798b8f76b74c80ee6a529750b63e7e43819b49d50cf: Status 404 returned error can't find the container with id ad61fbf046979b3d97a70798b8f76b74c80ee6a529750b63e7e43819b49d50cf Jul 21 14:17:55.648836 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.648765 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-c4p99" Jul 21 14:17:55.651588 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:55.651561 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ccfca56_0054_4006_be8c_2fb53147addd.slice/crio-2e30d9c0131640c7e8fc024b55a30a529a681c31bd86294050f73e7d25cfd3c5 WatchSource:0}: Error finding container 2e30d9c0131640c7e8fc024b55a30a529a681c31bd86294050f73e7d25cfd3c5: Status 404 returned error can't find the container with id 2e30d9c0131640c7e8fc024b55a30a529a681c31bd86294050f73e7d25cfd3c5 Jul 21 14:17:55.653796 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.653763 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjfwt" Jul 21 14:17:55.659522 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:55.659490 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10f6f6de_8f81_4811_9798_9bec360e01f7.slice/crio-58d6c3ec2797b59a6ae7531fb7dbd101f8811892b4d961422c44fea45ce083da WatchSource:0}: Error finding container 58d6c3ec2797b59a6ae7531fb7dbd101f8811892b4d961422c44fea45ce083da: Status 404 returned error can't find the container with id 58d6c3ec2797b59a6ae7531fb7dbd101f8811892b4d961422c44fea45ce083da Jul 21 14:17:55.660376 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.660352 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gfgt6" Jul 21 14:17:55.665263 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:55.665221 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d09a08b_bf2f_43b1_8ab2_91176c9db0db.slice/crio-ea0f9276c3927e80def6ce6b82c123ff274ba4540a5e990459af3dc12892d3ee WatchSource:0}: Error finding container ea0f9276c3927e80def6ce6b82c123ff274ba4540a5e990459af3dc12892d3ee: Status 404 returned error can't find the container with id ea0f9276c3927e80def6ce6b82c123ff274ba4540a5e990459af3dc12892d3ee Jul 21 14:17:55.666982 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.666947 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pnsb2" Jul 21 14:17:55.670407 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:55.670376 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32d461fa_ba21_427d_b9de_24cceea9e7c1.slice/crio-d4fe4737088a885c36fd54f071a5788885ebdfd1d3bb225eb1f8a9285050524f WatchSource:0}: Error finding container d4fe4737088a885c36fd54f071a5788885ebdfd1d3bb225eb1f8a9285050524f: Status 404 returned error can't find the container with id d4fe4737088a885c36fd54f071a5788885ebdfd1d3bb225eb1f8a9285050524f Jul 21 14:17:55.674221 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.674193 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-b5kkg" Jul 21 14:17:55.678188 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:55.678141 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8b7c0d1_1f08_4f0b_b2aa_c3085a5f1c10.slice/crio-92ddd84f74b8a31f05b2116b085ce6180b5a7ed9671c77a4bfb158752089c900 WatchSource:0}: Error finding container 92ddd84f74b8a31f05b2116b085ce6180b5a7ed9671c77a4bfb158752089c900: Status 404 returned error can't find the container with id 92ddd84f74b8a31f05b2116b085ce6180b5a7ed9671c77a4bfb158752089c900 Jul 21 14:17:55.680562 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.680526 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vhrsj" Jul 21 14:17:55.687124 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.687084 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2ct2w" Jul 21 14:17:55.687887 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:55.687846 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08737a2e_4e32_441c_b905_c2a2e41b1d17.slice/crio-b76bf31ac48ea09986e4416fbc86bed18683b577f9597a8f7c3e2200f2075db9 WatchSource:0}: Error finding container b76bf31ac48ea09986e4416fbc86bed18683b577f9597a8f7c3e2200f2075db9: Status 404 returned error can't find the container with id b76bf31ac48ea09986e4416fbc86bed18683b577f9597a8f7c3e2200f2075db9 Jul 21 14:17:55.691720 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:55.691679 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc22b3b26_5ab0_4206_aee9_9f10dbe890a1.slice/crio-30f6813d888ca7c11f178261b32ab5f0cf7505468a3c5a96ea3d3a4f23e9b848 WatchSource:0}: Error finding container 30f6813d888ca7c11f178261b32ab5f0cf7505468a3c5a96ea3d3a4f23e9b848: Status 404 returned error can't find the container with id 30f6813d888ca7c11f178261b32ab5f0cf7505468a3c5a96ea3d3a4f23e9b848 Jul 21 14:17:55.698694 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:17:55.698658 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d2e67d2_585f_46a1_9bff_fd6583e1d6f2.slice/crio-3ab3b16b17000ebcd14a1fa9d3b2de30b6a396e32eb29fdb32a66077d02d3043 WatchSource:0}: Error finding container 3ab3b16b17000ebcd14a1fa9d3b2de30b6a396e32eb29fdb32a66077d02d3043: Status 404 returned error can't find the container with id 3ab3b16b17000ebcd14a1fa9d3b2de30b6a396e32eb29fdb32a66077d02d3043 Jul 21 14:17:55.759325 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.759279 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 14:17:55.958960 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:55.958829 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f208bc8d-9c6c-4dc0-a7e3-a95c9e26c3d6-metrics-certs\") pod \"network-metrics-daemon-9tpq5\" (UID: \"f208bc8d-9c6c-4dc0-a7e3-a95c9e26c3d6\") " pod="openshift-multus/network-metrics-daemon-9tpq5" Jul 21 14:17:55.959187 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:17:55.959010 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 14:17:55.959187 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:17:55.959111 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f208bc8d-9c6c-4dc0-a7e3-a95c9e26c3d6-metrics-certs podName:f208bc8d-9c6c-4dc0-a7e3-a95c9e26c3d6 nodeName:}" failed. No retries permitted until 2026-07-21 14:17:56.95908582 +0000 UTC m=+3.976989374 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f208bc8d-9c6c-4dc0-a7e3-a95c9e26c3d6-metrics-certs") pod "network-metrics-daemon-9tpq5" (UID: "f208bc8d-9c6c-4dc0-a7e3-a95c9e26c3d6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 14:17:56.059777 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:56.059721 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrb74\" (UniqueName: \"kubernetes.io/projected/9d5c37aa-d496-4010-942a-92ead7dfa6b1-kube-api-access-wrb74\") pod \"network-check-target-fttn7\" (UID: \"9d5c37aa-d496-4010-942a-92ead7dfa6b1\") " pod="openshift-network-diagnostics/network-check-target-fttn7" Jul 21 14:17:56.060047 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:56.059827 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6ab945a0-5e72-4852-8a76-462020ef4af6-original-pull-secret\") pod \"global-pull-secret-syncer-4r4d6\" (UID: \"6ab945a0-5e72-4852-8a76-462020ef4af6\") " pod="kube-system/global-pull-secret-syncer-4r4d6" Jul 21 14:17:56.060047 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:17:56.059941 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 14:17:56.060047 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:17:56.060012 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ab945a0-5e72-4852-8a76-462020ef4af6-original-pull-secret podName:6ab945a0-5e72-4852-8a76-462020ef4af6 nodeName:}" failed. No retries permitted until 2026-07-21 14:17:57.059994874 +0000 UTC m=+4.077898428 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6ab945a0-5e72-4852-8a76-462020ef4af6-original-pull-secret") pod "global-pull-secret-syncer-4r4d6" (UID: "6ab945a0-5e72-4852-8a76-462020ef4af6") : object "kube-system"/"original-pull-secret" not registered Jul 21 14:17:56.060047 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:17:56.059943 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 14:17:56.060290 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:17:56.060060 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 14:17:56.060290 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:17:56.060074 2576 projected.go:196] Error preparing data for projected volume kube-api-access-wrb74 for pod openshift-network-diagnostics/network-check-target-fttn7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 14:17:56.060290 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:17:56.060127 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d5c37aa-d496-4010-942a-92ead7dfa6b1-kube-api-access-wrb74 podName:9d5c37aa-d496-4010-942a-92ead7dfa6b1 nodeName:}" failed. No retries permitted until 2026-07-21 14:17:57.060113474 +0000 UTC m=+4.078017032 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-wrb74" (UniqueName: "kubernetes.io/projected/9d5c37aa-d496-4010-942a-92ead7dfa6b1-kube-api-access-wrb74") pod "network-check-target-fttn7" (UID: "9d5c37aa-d496-4010-942a-92ead7dfa6b1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 14:17:56.389726 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:56.389645 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 14:12:55 +0000 UTC" deadline="2028-03-12 20:29:38.66486993 +0000 UTC" Jul 21 14:17:56.389726 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:56.389717 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14406h11m42.275157312s" Jul 21 14:17:56.533987 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:56.533808 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gfgt6" event={"ID":"32d461fa-ba21-427d-b9de-24cceea9e7c1","Type":"ContainerStarted","Data":"d4fe4737088a885c36fd54f071a5788885ebdfd1d3bb225eb1f8a9285050524f"} Jul 21 14:17:56.536339 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:56.536225 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjfwt" event={"ID":"7d09a08b-bf2f-43b1-8ab2-91176c9db0db","Type":"ContainerStarted","Data":"ea0f9276c3927e80def6ce6b82c123ff274ba4540a5e990459af3dc12892d3ee"} Jul 21 14:17:56.539392 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:56.539338 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c4p99" event={"ID":"10f6f6de-8f81-4811-9798-9bec360e01f7","Type":"ContainerStarted","Data":"58d6c3ec2797b59a6ae7531fb7dbd101f8811892b4d961422c44fea45ce083da"} Jul 21 14:17:56.543041 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:56.542960 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nxm5s" event={"ID":"8ccfca56-0054-4006-be8c-2fb53147addd","Type":"ContainerStarted","Data":"2e30d9c0131640c7e8fc024b55a30a529a681c31bd86294050f73e7d25cfd3c5"} Jul 21 14:17:56.550330 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:56.550185 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hs4wq" event={"ID":"6ad32aaa-9b75-431d-b467-6e3e01db7864","Type":"ContainerStarted","Data":"ad61fbf046979b3d97a70798b8f76b74c80ee6a529750b63e7e43819b49d50cf"} Jul 21 14:17:56.553360 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:56.553172 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2ct2w" event={"ID":"4d2e67d2-585f-46a1-9bff-fd6583e1d6f2","Type":"ContainerStarted","Data":"3ab3b16b17000ebcd14a1fa9d3b2de30b6a396e32eb29fdb32a66077d02d3043"} Jul 21 14:17:56.557622 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:56.557418 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-b5kkg" event={"ID":"08737a2e-4e32-441c-b905-c2a2e41b1d17","Type":"ContainerStarted","Data":"b76bf31ac48ea09986e4416fbc86bed18683b577f9597a8f7c3e2200f2075db9"} Jul 21 14:17:56.561004 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:56.560760 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pnsb2" event={"ID":"f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10","Type":"ContainerStarted","Data":"92ddd84f74b8a31f05b2116b085ce6180b5a7ed9671c77a4bfb158752089c900"} Jul 21 14:17:56.569801 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:56.569720 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vhrsj" event={"ID":"c22b3b26-5ab0-4206-aee9-9f10dbe890a1","Type":"ContainerStarted","Data":"30f6813d888ca7c11f178261b32ab5f0cf7505468a3c5a96ea3d3a4f23e9b848"} Jul 21 14:17:56.967651 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:56.967577 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f208bc8d-9c6c-4dc0-a7e3-a95c9e26c3d6-metrics-certs\") pod \"network-metrics-daemon-9tpq5\" (UID: \"f208bc8d-9c6c-4dc0-a7e3-a95c9e26c3d6\") " pod="openshift-multus/network-metrics-daemon-9tpq5" Jul 21 14:17:56.967977 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:17:56.967830 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 14:17:56.967977 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:17:56.967927 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f208bc8d-9c6c-4dc0-a7e3-a95c9e26c3d6-metrics-certs podName:f208bc8d-9c6c-4dc0-a7e3-a95c9e26c3d6 nodeName:}" failed. No retries permitted until 2026-07-21 14:17:58.967898162 +0000 UTC m=+5.985801718 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f208bc8d-9c6c-4dc0-a7e3-a95c9e26c3d6-metrics-certs") pod "network-metrics-daemon-9tpq5" (UID: "f208bc8d-9c6c-4dc0-a7e3-a95c9e26c3d6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 14:17:57.069621 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:57.068246 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrb74\" (UniqueName: \"kubernetes.io/projected/9d5c37aa-d496-4010-942a-92ead7dfa6b1-kube-api-access-wrb74\") pod \"network-check-target-fttn7\" (UID: \"9d5c37aa-d496-4010-942a-92ead7dfa6b1\") " pod="openshift-network-diagnostics/network-check-target-fttn7" Jul 21 14:17:57.069621 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:57.068389 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6ab945a0-5e72-4852-8a76-462020ef4af6-original-pull-secret\") pod \"global-pull-secret-syncer-4r4d6\" (UID: \"6ab945a0-5e72-4852-8a76-462020ef4af6\") " pod="kube-system/global-pull-secret-syncer-4r4d6" Jul 21 14:17:57.069621 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:17:57.068611 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 14:17:57.069621 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:17:57.068723 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ab945a0-5e72-4852-8a76-462020ef4af6-original-pull-secret podName:6ab945a0-5e72-4852-8a76-462020ef4af6 nodeName:}" failed. No retries permitted until 2026-07-21 14:17:59.068692139 +0000 UTC m=+6.086595696 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6ab945a0-5e72-4852-8a76-462020ef4af6-original-pull-secret") pod "global-pull-secret-syncer-4r4d6" (UID: "6ab945a0-5e72-4852-8a76-462020ef4af6") : object "kube-system"/"original-pull-secret" not registered Jul 21 14:17:57.069621 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:17:57.069427 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 14:17:57.069621 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:17:57.069466 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 14:17:57.069621 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:17:57.069484 2576 projected.go:196] Error preparing data for projected volume kube-api-access-wrb74 for pod openshift-network-diagnostics/network-check-target-fttn7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 14:17:57.069621 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:17:57.069557 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d5c37aa-d496-4010-942a-92ead7dfa6b1-kube-api-access-wrb74 podName:9d5c37aa-d496-4010-942a-92ead7dfa6b1 nodeName:}" failed. No retries permitted until 2026-07-21 14:17:59.069534706 +0000 UTC m=+6.087438271 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-wrb74" (UniqueName: "kubernetes.io/projected/9d5c37aa-d496-4010-942a-92ead7dfa6b1-kube-api-access-wrb74") pod "network-check-target-fttn7" (UID: "9d5c37aa-d496-4010-942a-92ead7dfa6b1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 14:17:57.390869 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:57.390766 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 14:12:55 +0000 UTC" deadline="2028-02-04 07:27:40.189480211 +0000 UTC" Jul 21 14:17:57.390869 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:57.390826 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13505h9m42.798660054s" Jul 21 14:17:57.523026 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:57.522989 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fttn7" Jul 21 14:17:57.523221 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:17:57.523153 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fttn7" podUID="9d5c37aa-d496-4010-942a-92ead7dfa6b1" Jul 21 14:17:57.523284 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:57.523262 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4r4d6" Jul 21 14:17:57.523357 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:17:57.523341 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4r4d6" podUID="6ab945a0-5e72-4852-8a76-462020ef4af6" Jul 21 14:17:57.523439 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:57.523415 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9tpq5" Jul 21 14:17:57.523538 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:17:57.523513 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9tpq5" podUID="f208bc8d-9c6c-4dc0-a7e3-a95c9e26c3d6" Jul 21 14:17:58.985225 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:58.985160 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f208bc8d-9c6c-4dc0-a7e3-a95c9e26c3d6-metrics-certs\") pod \"network-metrics-daemon-9tpq5\" (UID: \"f208bc8d-9c6c-4dc0-a7e3-a95c9e26c3d6\") " pod="openshift-multus/network-metrics-daemon-9tpq5" Jul 21 14:17:58.985894 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:17:58.985498 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 14:17:58.985894 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:17:58.985597 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f208bc8d-9c6c-4dc0-a7e3-a95c9e26c3d6-metrics-certs podName:f208bc8d-9c6c-4dc0-a7e3-a95c9e26c3d6 nodeName:}" failed. No retries permitted until 2026-07-21 14:18:02.985569403 +0000 UTC m=+10.003472979 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f208bc8d-9c6c-4dc0-a7e3-a95c9e26c3d6-metrics-certs") pod "network-metrics-daemon-9tpq5" (UID: "f208bc8d-9c6c-4dc0-a7e3-a95c9e26c3d6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 14:17:59.085938 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:59.085858 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6ab945a0-5e72-4852-8a76-462020ef4af6-original-pull-secret\") pod \"global-pull-secret-syncer-4r4d6\" (UID: \"6ab945a0-5e72-4852-8a76-462020ef4af6\") " pod="kube-system/global-pull-secret-syncer-4r4d6" Jul 21 14:17:59.086254 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:59.085995 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrb74\" (UniqueName: \"kubernetes.io/projected/9d5c37aa-d496-4010-942a-92ead7dfa6b1-kube-api-access-wrb74\") pod \"network-check-target-fttn7\" (UID: \"9d5c37aa-d496-4010-942a-92ead7dfa6b1\") " pod="openshift-network-diagnostics/network-check-target-fttn7" Jul 21 14:17:59.086364 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:17:59.086255 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 14:17:59.086364 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:17:59.086287 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 14:17:59.086364 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:17:59.086308 2576 projected.go:196] Error preparing data for projected volume kube-api-access-wrb74 for pod openshift-network-diagnostics/network-check-target-fttn7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 14:17:59.086499 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:17:59.086412 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d5c37aa-d496-4010-942a-92ead7dfa6b1-kube-api-access-wrb74 podName:9d5c37aa-d496-4010-942a-92ead7dfa6b1 nodeName:}" failed. No retries permitted until 2026-07-21 14:18:03.086382877 +0000 UTC m=+10.104286452 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-wrb74" (UniqueName: "kubernetes.io/projected/9d5c37aa-d496-4010-942a-92ead7dfa6b1-kube-api-access-wrb74") pod "network-check-target-fttn7" (UID: "9d5c37aa-d496-4010-942a-92ead7dfa6b1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 14:17:59.087201 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:17:59.087161 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 14:17:59.087431 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:17:59.087271 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ab945a0-5e72-4852-8a76-462020ef4af6-original-pull-secret podName:6ab945a0-5e72-4852-8a76-462020ef4af6 nodeName:}" failed. No retries permitted until 2026-07-21 14:18:03.087240435 +0000 UTC m=+10.105144000 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6ab945a0-5e72-4852-8a76-462020ef4af6-original-pull-secret") pod "global-pull-secret-syncer-4r4d6" (UID: "6ab945a0-5e72-4852-8a76-462020ef4af6") : object "kube-system"/"original-pull-secret" not registered Jul 21 14:17:59.524118 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:59.523117 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9tpq5" Jul 21 14:17:59.524118 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:17:59.523304 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9tpq5" podUID="f208bc8d-9c6c-4dc0-a7e3-a95c9e26c3d6" Jul 21 14:17:59.524118 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:59.523769 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4r4d6" Jul 21 14:17:59.524118 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:17:59.523901 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4r4d6" podUID="6ab945a0-5e72-4852-8a76-462020ef4af6" Jul 21 14:17:59.524118 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:17:59.523958 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fttn7" Jul 21 14:17:59.524118 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:17:59.524050 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fttn7" podUID="9d5c37aa-d496-4010-942a-92ead7dfa6b1" Jul 21 14:18:01.519653 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:01.519600 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fttn7" Jul 21 14:18:01.519653 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:01.519590 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9tpq5" Jul 21 14:18:01.520337 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:01.519800 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fttn7" podUID="9d5c37aa-d496-4010-942a-92ead7dfa6b1" Jul 21 14:18:01.520337 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:01.519861 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4r4d6" Jul 21 14:18:01.520337 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:01.520055 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4r4d6" podUID="6ab945a0-5e72-4852-8a76-462020ef4af6" Jul 21 14:18:01.520337 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:01.520203 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9tpq5" podUID="f208bc8d-9c6c-4dc0-a7e3-a95c9e26c3d6" Jul 21 14:18:03.023103 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:03.023066 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f208bc8d-9c6c-4dc0-a7e3-a95c9e26c3d6-metrics-certs\") pod \"network-metrics-daemon-9tpq5\" (UID: \"f208bc8d-9c6c-4dc0-a7e3-a95c9e26c3d6\") " pod="openshift-multus/network-metrics-daemon-9tpq5" Jul 21 14:18:03.023570 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:03.023274 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 14:18:03.023570 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:03.023340 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f208bc8d-9c6c-4dc0-a7e3-a95c9e26c3d6-metrics-certs podName:f208bc8d-9c6c-4dc0-a7e3-a95c9e26c3d6 nodeName:}" failed. No retries permitted until 2026-07-21 14:18:11.023321827 +0000 UTC m=+18.041225393 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f208bc8d-9c6c-4dc0-a7e3-a95c9e26c3d6-metrics-certs") pod "network-metrics-daemon-9tpq5" (UID: "f208bc8d-9c6c-4dc0-a7e3-a95c9e26c3d6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 14:18:03.125289 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:03.124307 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrb74\" (UniqueName: \"kubernetes.io/projected/9d5c37aa-d496-4010-942a-92ead7dfa6b1-kube-api-access-wrb74\") pod \"network-check-target-fttn7\" (UID: \"9d5c37aa-d496-4010-942a-92ead7dfa6b1\") " pod="openshift-network-diagnostics/network-check-target-fttn7" Jul 21 14:18:03.125289 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:03.124414 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6ab945a0-5e72-4852-8a76-462020ef4af6-original-pull-secret\") pod \"global-pull-secret-syncer-4r4d6\" (UID: \"6ab945a0-5e72-4852-8a76-462020ef4af6\") " pod="kube-system/global-pull-secret-syncer-4r4d6" Jul 21 14:18:03.125289 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:03.124615 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 14:18:03.125289 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:03.124715 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ab945a0-5e72-4852-8a76-462020ef4af6-original-pull-secret podName:6ab945a0-5e72-4852-8a76-462020ef4af6 nodeName:}" failed. No retries permitted until 2026-07-21 14:18:11.124688619 +0000 UTC m=+18.142592174 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6ab945a0-5e72-4852-8a76-462020ef4af6-original-pull-secret") pod "global-pull-secret-syncer-4r4d6" (UID: "6ab945a0-5e72-4852-8a76-462020ef4af6") : object "kube-system"/"original-pull-secret" not registered Jul 21 14:18:03.125289 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:03.124875 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 14:18:03.125289 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:03.124905 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 14:18:03.125289 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:03.124925 2576 projected.go:196] Error preparing data for projected volume kube-api-access-wrb74 for pod openshift-network-diagnostics/network-check-target-fttn7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 14:18:03.125289 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:03.125009 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d5c37aa-d496-4010-942a-92ead7dfa6b1-kube-api-access-wrb74 podName:9d5c37aa-d496-4010-942a-92ead7dfa6b1 nodeName:}" failed. No retries permitted until 2026-07-21 14:18:11.124983724 +0000 UTC m=+18.142887298 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-wrb74" (UniqueName: "kubernetes.io/projected/9d5c37aa-d496-4010-942a-92ead7dfa6b1-kube-api-access-wrb74") pod "network-check-target-fttn7" (UID: "9d5c37aa-d496-4010-942a-92ead7dfa6b1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 14:18:03.520965 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:03.520845 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fttn7" Jul 21 14:18:03.520965 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:03.520907 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4r4d6" Jul 21 14:18:03.521326 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:03.521004 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9tpq5" Jul 21 14:18:03.521326 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:03.521208 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9tpq5" podUID="f208bc8d-9c6c-4dc0-a7e3-a95c9e26c3d6" Jul 21 14:18:03.521996 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:03.521765 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fttn7" podUID="9d5c37aa-d496-4010-942a-92ead7dfa6b1" Jul 21 14:18:03.521996 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:03.521932 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4r4d6" podUID="6ab945a0-5e72-4852-8a76-462020ef4af6" Jul 21 14:18:05.520594 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:05.520499 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4r4d6" Jul 21 14:18:05.521334 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:05.520499 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fttn7" Jul 21 14:18:05.521334 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:05.520737 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4r4d6" podUID="6ab945a0-5e72-4852-8a76-462020ef4af6" Jul 21 14:18:05.521334 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:05.520846 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fttn7" podUID="9d5c37aa-d496-4010-942a-92ead7dfa6b1" Jul 21 14:18:05.521334 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:05.520535 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9tpq5" Jul 21 14:18:05.521334 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:05.520988 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9tpq5" podUID="f208bc8d-9c6c-4dc0-a7e3-a95c9e26c3d6" Jul 21 14:18:07.519947 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:07.519905 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4r4d6" Jul 21 14:18:07.520444 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:07.519903 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fttn7" Jul 21 14:18:07.520444 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:07.520040 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4r4d6" podUID="6ab945a0-5e72-4852-8a76-462020ef4af6" Jul 21 14:18:07.520444 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:07.519905 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9tpq5" Jul 21 14:18:07.520444 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:07.520095 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fttn7" podUID="9d5c37aa-d496-4010-942a-92ead7dfa6b1" Jul 21 14:18:07.520444 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:07.520216 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9tpq5" podUID="f208bc8d-9c6c-4dc0-a7e3-a95c9e26c3d6" Jul 21 14:18:09.519685 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:09.519636 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4r4d6" Jul 21 14:18:09.520241 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:09.519709 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9tpq5" Jul 21 14:18:09.520241 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:09.519636 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fttn7" Jul 21 14:18:09.520241 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:09.519826 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4r4d6" podUID="6ab945a0-5e72-4852-8a76-462020ef4af6" Jul 21 14:18:09.520241 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:09.519978 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fttn7" podUID="9d5c37aa-d496-4010-942a-92ead7dfa6b1" Jul 21 14:18:09.520241 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:09.520072 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9tpq5" podUID="f208bc8d-9c6c-4dc0-a7e3-a95c9e26c3d6" Jul 21 14:18:11.101245 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:11.101173 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f208bc8d-9c6c-4dc0-a7e3-a95c9e26c3d6-metrics-certs\") pod \"network-metrics-daemon-9tpq5\" (UID: \"f208bc8d-9c6c-4dc0-a7e3-a95c9e26c3d6\") " pod="openshift-multus/network-metrics-daemon-9tpq5" Jul 21 14:18:11.102111 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:11.101420 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 14:18:11.102111 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:11.101563 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f208bc8d-9c6c-4dc0-a7e3-a95c9e26c3d6-metrics-certs podName:f208bc8d-9c6c-4dc0-a7e3-a95c9e26c3d6 nodeName:}" failed. No retries permitted until 2026-07-21 14:18:27.101532078 +0000 UTC m=+34.119435630 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f208bc8d-9c6c-4dc0-a7e3-a95c9e26c3d6-metrics-certs") pod "network-metrics-daemon-9tpq5" (UID: "f208bc8d-9c6c-4dc0-a7e3-a95c9e26c3d6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 14:18:11.202659 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:11.202609 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6ab945a0-5e72-4852-8a76-462020ef4af6-original-pull-secret\") pod \"global-pull-secret-syncer-4r4d6\" (UID: \"6ab945a0-5e72-4852-8a76-462020ef4af6\") " pod="kube-system/global-pull-secret-syncer-4r4d6" Jul 21 14:18:11.202964 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:11.202707 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrb74\" (UniqueName: \"kubernetes.io/projected/9d5c37aa-d496-4010-942a-92ead7dfa6b1-kube-api-access-wrb74\") pod \"network-check-target-fttn7\" (UID: \"9d5c37aa-d496-4010-942a-92ead7dfa6b1\") " pod="openshift-network-diagnostics/network-check-target-fttn7" Jul 21 14:18:11.202964 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:11.202838 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 14:18:11.202964 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:11.202875 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 14:18:11.202964 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:11.202895 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 14:18:11.202964 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:11.202911 2576 projected.go:196] Error preparing data for projected volume kube-api-access-wrb74 for pod openshift-network-diagnostics/network-check-target-fttn7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 14:18:11.202964 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:11.202936 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ab945a0-5e72-4852-8a76-462020ef4af6-original-pull-secret podName:6ab945a0-5e72-4852-8a76-462020ef4af6 nodeName:}" failed. No retries permitted until 2026-07-21 14:18:27.202909058 +0000 UTC m=+34.220812627 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6ab945a0-5e72-4852-8a76-462020ef4af6-original-pull-secret") pod "global-pull-secret-syncer-4r4d6" (UID: "6ab945a0-5e72-4852-8a76-462020ef4af6") : object "kube-system"/"original-pull-secret" not registered Jul 21 14:18:11.202964 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:11.202952 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d5c37aa-d496-4010-942a-92ead7dfa6b1-kube-api-access-wrb74 podName:9d5c37aa-d496-4010-942a-92ead7dfa6b1 nodeName:}" failed. No retries permitted until 2026-07-21 14:18:27.202942718 +0000 UTC m=+34.220846289 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-wrb74" (UniqueName: "kubernetes.io/projected/9d5c37aa-d496-4010-942a-92ead7dfa6b1-kube-api-access-wrb74") pod "network-check-target-fttn7" (UID: "9d5c37aa-d496-4010-942a-92ead7dfa6b1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 14:18:11.520417 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:11.520365 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9tpq5" Jul 21 14:18:11.520644 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:11.520365 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4r4d6" Jul 21 14:18:11.520644 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:11.520534 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9tpq5" podUID="f208bc8d-9c6c-4dc0-a7e3-a95c9e26c3d6" Jul 21 14:18:11.520644 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:11.520365 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fttn7" Jul 21 14:18:11.520644 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:11.520598 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4r4d6" podUID="6ab945a0-5e72-4852-8a76-462020ef4af6" Jul 21 14:18:11.520882 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:11.520658 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fttn7" podUID="9d5c37aa-d496-4010-942a-92ead7dfa6b1" Jul 21 14:18:13.520910 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:13.520871 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fttn7" Jul 21 14:18:13.521405 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:13.520964 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fttn7" podUID="9d5c37aa-d496-4010-942a-92ead7dfa6b1" Jul 21 14:18:13.521405 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:13.521336 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4r4d6" Jul 21 14:18:13.521574 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:13.521430 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4r4d6" podUID="6ab945a0-5e72-4852-8a76-462020ef4af6" Jul 21 14:18:13.521574 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:13.521478 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9tpq5" Jul 21 14:18:13.521574 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:13.521559 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9tpq5" podUID="f208bc8d-9c6c-4dc0-a7e3-a95c9e26c3d6" Jul 21 14:18:15.520640 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:15.520583 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fttn7" Jul 21 14:18:15.521419 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:15.520591 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9tpq5" Jul 21 14:18:15.521419 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:15.520744 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fttn7" podUID="9d5c37aa-d496-4010-942a-92ead7dfa6b1" Jul 21 14:18:15.521419 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:15.520887 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9tpq5" podUID="f208bc8d-9c6c-4dc0-a7e3-a95c9e26c3d6" Jul 21 14:18:15.521419 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:15.520583 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4r4d6" Jul 21 14:18:15.521419 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:15.520991 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4r4d6" podUID="6ab945a0-5e72-4852-8a76-462020ef4af6" Jul 21 14:18:16.628000 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:16.627698 2576 generic.go:356] "Generic (PLEG): container finished" podID="c22b3b26-5ab0-4206-aee9-9f10dbe890a1" containerID="d11dff4de7f9687afc6bd9b3551ca8a4b85db7dc78f1ef3a5e472fc73454dcf9" exitCode=0 Jul 21 14:18:16.628887 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:16.627803 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vhrsj" event={"ID":"c22b3b26-5ab0-4206-aee9-9f10dbe890a1","Type":"ContainerDied","Data":"d11dff4de7f9687afc6bd9b3551ca8a4b85db7dc78f1ef3a5e472fc73454dcf9"} Jul 21 14:18:16.630373 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:16.630336 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gfgt6" event={"ID":"32d461fa-ba21-427d-b9de-24cceea9e7c1","Type":"ContainerStarted","Data":"30693a847d77c04b9278588a4dfa65d7cc3cb5137015cf8a8787968db4f5f48a"} Jul 21 14:18:16.632570 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:16.632531 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjfwt" event={"ID":"7d09a08b-bf2f-43b1-8ab2-91176c9db0db","Type":"ContainerStarted","Data":"0325d96217807925a098a0cc9e66102eb5c7b6e30a46b2a930c706a583d791ef"} Jul 21 14:18:16.636753 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:16.636432 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c4p99" event={"ID":"10f6f6de-8f81-4811-9798-9bec360e01f7","Type":"ContainerStarted","Data":"df24e4c350dcb4b220be05f35ee01a4d2b361aa4071a2b605313b07471013744"} Jul 21 14:18:16.636753 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:16.636554 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c4p99" event={"ID":"10f6f6de-8f81-4811-9798-9bec360e01f7","Type":"ContainerStarted","Data":"28c121a53432425187b8fda28ad8fa5fd6d9fedcfc0c939e00b357429da3ef5f"} Jul 21 14:18:16.636753 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:16.636609 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c4p99" event={"ID":"10f6f6de-8f81-4811-9798-9bec360e01f7","Type":"ContainerStarted","Data":"2df9a511501556400e8094f837c7edfe5f3d422e0c3761db7f6a45790350cee9"} Jul 21 14:18:16.636753 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:16.636655 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c4p99" event={"ID":"10f6f6de-8f81-4811-9798-9bec360e01f7","Type":"ContainerStarted","Data":"596022e6adc0aa48f1e9df462ed5d734994be5a16dc90f77df51ee11de72b64d"} Jul 21 14:18:16.636753 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:16.636697 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c4p99" event={"ID":"10f6f6de-8f81-4811-9798-9bec360e01f7","Type":"ContainerStarted","Data":"09d7f0e144e95cf921e9c1779a9a252a992c0251c97265627d3748e8c033d10e"} Jul 21 14:18:16.638393 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:16.638350 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nxm5s" event={"ID":"8ccfca56-0054-4006-be8c-2fb53147addd","Type":"ContainerStarted","Data":"fde6f9451be3f9f781d2fd305699898f74d6d4daa29a70c2ac35a0b21435c691"} Jul 21 14:18:16.640161 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:16.640098 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hs4wq" event={"ID":"6ad32aaa-9b75-431d-b467-6e3e01db7864","Type":"ContainerStarted","Data":"edec61c9c6cdd02e878985fed940c09da6a718a36ced31619b6c67f4b584b8e6"} Jul 21 14:18:16.641898 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:16.641863 2576 generic.go:356] "Generic (PLEG): container finished" podID="d39c96e45fa97134bd3353fcd622d146" containerID="37a866a916ca1932be7bb21ff70e0c0e446cbd7abba0318112d50fc9e1a35c7c" exitCode=0 Jul 21 14:18:16.642037 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:16.641933 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-199.ec2.internal" event={"ID":"d39c96e45fa97134bd3353fcd622d146","Type":"ContainerDied","Data":"37a866a916ca1932be7bb21ff70e0c0e446cbd7abba0318112d50fc9e1a35c7c"} Jul 21 14:18:16.643715 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:16.643671 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-b5kkg" event={"ID":"08737a2e-4e32-441c-b905-c2a2e41b1d17","Type":"ContainerStarted","Data":"cc32f3812bc6a0f3cde05bef80c279e20ad10bef072600857c6b262ac4bc9397"} Jul 21 14:18:16.645823 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:16.645773 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pnsb2" event={"ID":"f8b7c0d1-1f08-4f0b-b2aa-c3085a5f1c10","Type":"ContainerStarted","Data":"ce1fad32daa347e2621cb4cc8199bf0e087cb64fdf8ae2fa56fe03b05945bb72"} Jul 21 14:18:16.647187 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:16.647146 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-199.ec2.internal" event={"ID":"1fa232d68d89be7b5a77b2100c544fdb","Type":"ContainerStarted","Data":"9edbf74d9f5079657d46262d776db3551ca251e2bb639f40206486f2ddfe04f4"} Jul 21 14:18:16.677912 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:16.677850 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-gfgt6" podStartSLOduration=11.642339055 podStartE2EDuration="23.677828408s" totalImagesPullingTime="12.035489353s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:17:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:18:16.67722597 +0000 UTC m=+23.695129547" watchObservedRunningTime="2026-07-21 14:18:16.677828408 +0000 UTC m=+23.695731982" Jul 21 14:18:16.700356 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:16.700284 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-pnsb2" podStartSLOduration=3.623560689 podStartE2EDuration="23.700261795s" totalImagesPullingTime="20.076701106s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 14:17:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:18:16.699692027 +0000 UTC m=+23.717595605" watchObservedRunningTime="2026-07-21 14:18:16.700261795 +0000 UTC m=+23.718165369" Jul 21 14:18:16.718356 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:16.718300 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-b5kkg" podStartSLOduration=3.670706646 podStartE2EDuration="23.718283398s" totalImagesPullingTime="20.047576752s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 14:17:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:18:16.718146051 +0000 UTC m=+23.736049626" watchObservedRunningTime="2026-07-21 14:18:16.718283398 +0000 UTC m=+23.736186973" Jul 21 14:18:16.742581 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:16.742510 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-hs4wq" podStartSLOduration=3.578409956 podStartE2EDuration="23.742488424s" totalImagesPullingTime="20.164078468s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 14:17:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:18:16.741874584 +0000 UTC m=+23.759778161" watchObservedRunningTime="2026-07-21 14:18:16.742488424 +0000 UTC m=+23.760391997" Jul 21 14:18:17.519702 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:17.519645 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4r4d6" Jul 21 14:18:17.520116 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:17.519645 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fttn7" Jul 21 14:18:17.520116 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:17.519651 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9tpq5" Jul 21 14:18:17.520116 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:17.519835 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4r4d6" podUID="6ab945a0-5e72-4852-8a76-462020ef4af6" Jul 21 14:18:17.520116 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:17.519878 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fttn7" podUID="9d5c37aa-d496-4010-942a-92ead7dfa6b1" Jul 21 14:18:17.520116 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:17.519930 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9tpq5" podUID="f208bc8d-9c6c-4dc0-a7e3-a95c9e26c3d6" Jul 21 14:18:17.656153 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:17.656071 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c4p99" event={"ID":"10f6f6de-8f81-4811-9798-9bec360e01f7","Type":"ContainerStarted","Data":"f7c6c87e5cc807b17dd2d1b751b25395d2a34641aeac5bd01bb0b86a1a95462e"} Jul 21 14:18:17.658394 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:17.658317 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2ct2w" event={"ID":"4d2e67d2-585f-46a1-9bff-fd6583e1d6f2","Type":"ContainerStarted","Data":"bf4e7e4911e2350985ba71ae1ecb3e17fb69131762b389f07c38f7738a790d97"} Jul 21 14:18:17.687924 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:17.687214 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-nxm5s" podStartSLOduration=4.60151948 podStartE2EDuration="24.685050983s" totalImagesPullingTime="20.083531503s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 14:17:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:18:16.760626906 +0000 UTC m=+23.778530490" watchObservedRunningTime="2026-07-21 14:18:17.685050983 +0000 UTC m=+24.702954558" Jul 21 14:18:17.709175 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:17.709058 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-2ct2w" podStartSLOduration=3.6702025369999998 podStartE2EDuration="23.709021632s" totalImagesPullingTime="20.038819095s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 14:17:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:18:17.708349661 +0000 UTC m=+24.726253234" watchObservedRunningTime="2026-07-21 14:18:17.709021632 +0000 UTC m=+24.726925205" Jul 21 14:18:17.716471 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:17.716415 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-gfgt6" Jul 21 14:18:17.718279 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:17.717852 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-gfgt6" Jul 21 14:18:18.336298 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:18.336260 2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 21 14:18:18.421511 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:18.421421 2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-21T14:18:18.336289194Z","UUID":"469a4eaa-f5f9-4749-8bb2-7313bc3cde7f","Handler":null,"Name":"","Endpoint":""} Jul 21 14:18:18.422931 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:18.422912 2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 21 14:18:18.423120 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:18.422954 2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 21 14:18:18.662273 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:18.662242 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjfwt" event={"ID":"7d09a08b-bf2f-43b1-8ab2-91176c9db0db","Type":"ContainerStarted","Data":"d5947dce044acc5bfdcf3e6403f3d143feb341c66ca65f020b5aec1d4e1aea63"} Jul 21 14:18:18.664086 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:18.664060 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-199.ec2.internal" event={"ID":"d39c96e45fa97134bd3353fcd622d146","Type":"ContainerStarted","Data":"36c5bd3a94c9d016b1aa3d9cb924b771a4f341c45f9a3dc68714d0d3db611e65"} Jul 21 14:18:18.665350 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:18.665320 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-199.ec2.internal" event={"ID":"1fa232d68d89be7b5a77b2100c544fdb","Type":"ContainerStarted","Data":"0fa30f7b1eefe0902472d387265bc630ba0ec8bcdc7fc0b29b9f99da25c6c23c"} Jul 21 14:18:18.665486 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:18.665387 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-gfgt6" Jul 21 14:18:18.665968 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:18.665947 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-gfgt6" Jul 21 14:18:18.698748 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:18.698680 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-199.ec2.internal" podStartSLOduration=23.69865867 podStartE2EDuration="23.69865867s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 14:17:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:18:18.681887008 +0000 UTC m=+25.699790594" watchObservedRunningTime="2026-07-21 14:18:18.69865867 +0000 UTC m=+25.716562259" Jul 21 14:18:18.699249 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:18.699209 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-199.ec2.internal" podStartSLOduration=23.699197676 podStartE2EDuration="23.699197676s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 14:17:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:18:18.698140969 +0000 UTC m=+25.716044543" watchObservedRunningTime="2026-07-21 14:18:18.699197676 +0000 UTC m=+25.717101252" Jul 21 14:18:19.519723 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:19.519686 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fttn7" Jul 21 14:18:19.520078 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:19.519686 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4r4d6" Jul 21 14:18:19.520078 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:19.519840 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fttn7" podUID="9d5c37aa-d496-4010-942a-92ead7dfa6b1" Jul 21 14:18:19.520078 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:19.519858 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9tpq5" Jul 21 14:18:19.520078 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:19.519999 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4r4d6" podUID="6ab945a0-5e72-4852-8a76-462020ef4af6" Jul 21 14:18:19.520301 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:19.520081 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9tpq5" podUID="f208bc8d-9c6c-4dc0-a7e3-a95c9e26c3d6" Jul 21 14:18:19.673028 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:19.672957 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c4p99" event={"ID":"10f6f6de-8f81-4811-9798-9bec360e01f7","Type":"ContainerStarted","Data":"2099b42b532ba4da17c841b22d3b1b8b67d0c0346d3d25ab48dc3ac5ba3eb37a"} Jul 21 14:18:20.679602 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:20.679543 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjfwt" event={"ID":"7d09a08b-bf2f-43b1-8ab2-91176c9db0db","Type":"ContainerStarted","Data":"b03b1037b629273b98272a3b85fe10d89ca56bac5f9c2e7cf8836130cdf5762e"} Jul 21 14:18:21.520356 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:21.520319 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fttn7" Jul 21 14:18:21.520550 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:21.520318 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4r4d6" Jul 21 14:18:21.520550 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:21.520471 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fttn7" podUID="9d5c37aa-d496-4010-942a-92ead7dfa6b1" Jul 21 14:18:21.520550 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:21.520324 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9tpq5" Jul 21 14:18:21.520713 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:21.520553 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4r4d6" podUID="6ab945a0-5e72-4852-8a76-462020ef4af6" Jul 21 14:18:21.520713 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:21.520637 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9tpq5" podUID="f208bc8d-9c6c-4dc0-a7e3-a95c9e26c3d6" Jul 21 14:18:22.686706 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:22.686342 2576 generic.go:356] "Generic (PLEG): container finished" podID="c22b3b26-5ab0-4206-aee9-9f10dbe890a1" containerID="ac24e62d92e2da06149b6e5918068b063b3dc17a1dba1abe335a74cc38411098" exitCode=0 Jul 21 14:18:22.686706 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:22.686430 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vhrsj" event={"ID":"c22b3b26-5ab0-4206-aee9-9f10dbe890a1","Type":"ContainerDied","Data":"ac24e62d92e2da06149b6e5918068b063b3dc17a1dba1abe335a74cc38411098"} Jul 21 14:18:22.691663 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:22.691629 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c4p99" event={"ID":"10f6f6de-8f81-4811-9798-9bec360e01f7","Type":"ContainerStarted","Data":"e37c39bc460bae783ec32d7d806ef3b5360883f45376111ecca241ccf031e797"} Jul 21 14:18:22.691997 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:22.691968 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-c4p99" Jul 21 14:18:22.713237 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:22.713202 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-c4p99" Jul 21 14:18:22.720005 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:22.719941 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjfwt" podStartSLOduration=5.969718027 podStartE2EDuration="29.719920688s" totalImagesPullingTime="23.750202661s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 14:17:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:18:20.707341871 +0000 UTC m=+27.725245446" watchObservedRunningTime="2026-07-21 14:18:22.719920688 +0000 UTC m=+29.737824353" Jul 21 14:18:23.521603 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:23.521528 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9tpq5" Jul 21 14:18:23.521603 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:23.521595 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fttn7" Jul 21 14:18:23.522120 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:23.521545 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4r4d6" Jul 21 14:18:23.522120 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:23.521735 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9tpq5" podUID="f208bc8d-9c6c-4dc0-a7e3-a95c9e26c3d6" Jul 21 14:18:23.522120 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:23.521883 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4r4d6" podUID="6ab945a0-5e72-4852-8a76-462020ef4af6" Jul 21 14:18:23.522120 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:23.522024 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fttn7" podUID="9d5c37aa-d496-4010-942a-92ead7dfa6b1" Jul 21 14:18:23.694345 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:23.694298 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-c4p99" Jul 21 14:18:23.694891 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:23.694374 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-c4p99" Jul 21 14:18:23.712804 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:23.712758 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-c4p99" Jul 21 14:18:23.750690 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:23.750629 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-c4p99" podStartSLOduration=10.60436864 podStartE2EDuration="30.750614043s" totalImagesPullingTime="20.146245403s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 14:17:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:18:22.762452896 +0000 UTC m=+29.780356463" watchObservedRunningTime="2026-07-21 14:18:23.750614043 +0000 UTC m=+30.768517667" Jul 21 14:18:24.698889 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:24.698850 2576 generic.go:356] "Generic (PLEG): container finished" podID="c22b3b26-5ab0-4206-aee9-9f10dbe890a1" containerID="386b616a5c3272daf7c8a2d0a1154086acbbb96c5c0c155584921d7be4030a64" exitCode=0 Jul 21 14:18:24.699506 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:24.698931 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vhrsj" event={"ID":"c22b3b26-5ab0-4206-aee9-9f10dbe890a1","Type":"ContainerDied","Data":"386b616a5c3272daf7c8a2d0a1154086acbbb96c5c0c155584921d7be4030a64"} Jul 21 14:18:25.520413 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:25.520354 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4r4d6" Jul 21 14:18:25.520715 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:25.520373 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9tpq5" Jul 21 14:18:25.520715 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:25.520536 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4r4d6" podUID="6ab945a0-5e72-4852-8a76-462020ef4af6" Jul 21 14:18:25.520715 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:25.520376 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fttn7" Jul 21 14:18:25.520715 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:25.520618 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9tpq5" podUID="f208bc8d-9c6c-4dc0-a7e3-a95c9e26c3d6" Jul 21 14:18:25.520715 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:25.520682 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fttn7" podUID="9d5c37aa-d496-4010-942a-92ead7dfa6b1" Jul 21 14:18:26.708918 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:26.708860 2576 generic.go:356] "Generic (PLEG): container finished" podID="c22b3b26-5ab0-4206-aee9-9f10dbe890a1" containerID="dd770b8bf6b77345dbb091fa080bd8c11410bf0404551fc564563f2589f3e4fc" exitCode=0 Jul 21 14:18:26.708918 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:26.708903 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vhrsj" event={"ID":"c22b3b26-5ab0-4206-aee9-9f10dbe890a1","Type":"ContainerDied","Data":"dd770b8bf6b77345dbb091fa080bd8c11410bf0404551fc564563f2589f3e4fc"} Jul 21 14:18:27.140547 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:27.140497 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f208bc8d-9c6c-4dc0-a7e3-a95c9e26c3d6-metrics-certs\") pod \"network-metrics-daemon-9tpq5\" (UID: \"f208bc8d-9c6c-4dc0-a7e3-a95c9e26c3d6\") " pod="openshift-multus/network-metrics-daemon-9tpq5" Jul 21 14:18:27.140770 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:27.140675 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 14:18:27.140770 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:27.140743 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f208bc8d-9c6c-4dc0-a7e3-a95c9e26c3d6-metrics-certs podName:f208bc8d-9c6c-4dc0-a7e3-a95c9e26c3d6 nodeName:}" failed. No retries permitted until 2026-07-21 14:18:59.140724138 +0000 UTC m=+66.158627694 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f208bc8d-9c6c-4dc0-a7e3-a95c9e26c3d6-metrics-certs") pod "network-metrics-daemon-9tpq5" (UID: "f208bc8d-9c6c-4dc0-a7e3-a95c9e26c3d6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 14:18:27.241855 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:27.241821 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6ab945a0-5e72-4852-8a76-462020ef4af6-original-pull-secret\") pod \"global-pull-secret-syncer-4r4d6\" (UID: \"6ab945a0-5e72-4852-8a76-462020ef4af6\") " pod="kube-system/global-pull-secret-syncer-4r4d6" Jul 21 14:18:27.242024 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:27.241878 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrb74\" (UniqueName: \"kubernetes.io/projected/9d5c37aa-d496-4010-942a-92ead7dfa6b1-kube-api-access-wrb74\") pod \"network-check-target-fttn7\" (UID: \"9d5c37aa-d496-4010-942a-92ead7dfa6b1\") " pod="openshift-network-diagnostics/network-check-target-fttn7" Jul 21 14:18:27.242024 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:27.242007 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 14:18:27.242093 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:27.242026 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 14:18:27.242093 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:27.242089 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ab945a0-5e72-4852-8a76-462020ef4af6-original-pull-secret podName:6ab945a0-5e72-4852-8a76-462020ef4af6 nodeName:}" failed. No retries permitted until 2026-07-21 14:18:59.242073981 +0000 UTC m=+66.259977536 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6ab945a0-5e72-4852-8a76-462020ef4af6-original-pull-secret") pod "global-pull-secret-syncer-4r4d6" (UID: "6ab945a0-5e72-4852-8a76-462020ef4af6") : object "kube-system"/"original-pull-secret" not registered Jul 21 14:18:27.242160 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:27.242030 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 14:18:27.242160 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:27.242111 2576 projected.go:196] Error preparing data for projected volume kube-api-access-wrb74 for pod openshift-network-diagnostics/network-check-target-fttn7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 14:18:27.242160 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:27.242139 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d5c37aa-d496-4010-942a-92ead7dfa6b1-kube-api-access-wrb74 podName:9d5c37aa-d496-4010-942a-92ead7dfa6b1 nodeName:}" failed. No retries permitted until 2026-07-21 14:18:59.242133357 +0000 UTC m=+66.260036909 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-wrb74" (UniqueName: "kubernetes.io/projected/9d5c37aa-d496-4010-942a-92ead7dfa6b1-kube-api-access-wrb74") pod "network-check-target-fttn7" (UID: "9d5c37aa-d496-4010-942a-92ead7dfa6b1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 14:18:27.519727 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:27.519679 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4r4d6" Jul 21 14:18:27.519996 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:27.519699 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fttn7" Jul 21 14:18:27.519996 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:27.519838 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9tpq5" Jul 21 14:18:27.519996 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:27.519864 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4r4d6" podUID="6ab945a0-5e72-4852-8a76-462020ef4af6" Jul 21 14:18:27.519996 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:27.519962 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9tpq5" podUID="f208bc8d-9c6c-4dc0-a7e3-a95c9e26c3d6" Jul 21 14:18:27.520204 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:27.520054 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fttn7" podUID="9d5c37aa-d496-4010-942a-92ead7dfa6b1" Jul 21 14:18:29.520726 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:29.520661 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fttn7" Jul 21 14:18:29.521329 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:29.520694 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4r4d6" Jul 21 14:18:29.521329 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:29.520694 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9tpq5" Jul 21 14:18:29.521329 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:29.520874 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fttn7" podUID="9d5c37aa-d496-4010-942a-92ead7dfa6b1" Jul 21 14:18:29.521329 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:29.521036 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4r4d6" podUID="6ab945a0-5e72-4852-8a76-462020ef4af6" Jul 21 14:18:29.521329 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:29.521196 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9tpq5" podUID="f208bc8d-9c6c-4dc0-a7e3-a95c9e26c3d6" Jul 21 14:18:30.700218 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:30.699829 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4r4d6"] Jul 21 14:18:30.700863 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:30.700383 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4r4d6" Jul 21 14:18:30.700863 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:30.700555 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4r4d6" podUID="6ab945a0-5e72-4852-8a76-462020ef4af6" Jul 21 14:18:30.704237 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:30.704084 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fttn7"] Jul 21 14:18:30.704237 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:30.704189 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9tpq5"] Jul 21 14:18:30.704461 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:30.704284 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9tpq5" Jul 21 14:18:30.704461 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:30.704314 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fttn7" Jul 21 14:18:30.704461 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:30.704439 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9tpq5" podUID="f208bc8d-9c6c-4dc0-a7e3-a95c9e26c3d6" Jul 21 14:18:30.704624 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:30.704564 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fttn7" podUID="9d5c37aa-d496-4010-942a-92ead7dfa6b1" Jul 21 14:18:32.520666 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:32.520522 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9tpq5" Jul 21 14:18:32.520666 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:32.520593 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fttn7" Jul 21 14:18:32.520666 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:32.520545 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4r4d6" Jul 21 14:18:32.521252 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:32.520698 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9tpq5" podUID="f208bc8d-9c6c-4dc0-a7e3-a95c9e26c3d6" Jul 21 14:18:32.521252 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:32.520822 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4r4d6" podUID="6ab945a0-5e72-4852-8a76-462020ef4af6" Jul 21 14:18:32.521252 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:32.520906 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fttn7" podUID="9d5c37aa-d496-4010-942a-92ead7dfa6b1" Jul 21 14:18:32.731258 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:32.731219 2576 generic.go:356] "Generic (PLEG): container finished" podID="c22b3b26-5ab0-4206-aee9-9f10dbe890a1" containerID="3cb485613769b6a41fce3378588fb1a59a6b7ac1908185c800f21835ceedf7ab" exitCode=0 Jul 21 14:18:32.731484 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:32.731274 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vhrsj" event={"ID":"c22b3b26-5ab0-4206-aee9-9f10dbe890a1","Type":"ContainerDied","Data":"3cb485613769b6a41fce3378588fb1a59a6b7ac1908185c800f21835ceedf7ab"} Jul 21 14:18:33.739160 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:33.738879 2576 generic.go:356] "Generic (PLEG): container finished" podID="c22b3b26-5ab0-4206-aee9-9f10dbe890a1" containerID="d04faf74ae64fa36d9dc12d5d83c2980875bfc5ffe5e3c8b7ae90793d5cfbef3" exitCode=0 Jul 21 14:18:33.739160 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:33.738956 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vhrsj" event={"ID":"c22b3b26-5ab0-4206-aee9-9f10dbe890a1","Type":"ContainerDied","Data":"d04faf74ae64fa36d9dc12d5d83c2980875bfc5ffe5e3c8b7ae90793d5cfbef3"} Jul 21 14:18:34.520553 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:34.520504 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9tpq5" Jul 21 14:18:34.520766 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:34.520504 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fttn7" Jul 21 14:18:34.520766 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:34.520504 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4r4d6" Jul 21 14:18:34.520939 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:34.520772 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fttn7" podUID="9d5c37aa-d496-4010-942a-92ead7dfa6b1" Jul 21 14:18:34.520939 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:34.520651 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9tpq5" podUID="f208bc8d-9c6c-4dc0-a7e3-a95c9e26c3d6" Jul 21 14:18:34.520939 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:34.520867 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4r4d6" podUID="6ab945a0-5e72-4852-8a76-462020ef4af6" Jul 21 14:18:34.735721 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:34.735614 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-199.ec2.internal" event="NodeReady" Jul 21 14:18:34.735927 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:34.735817 2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 21 14:18:34.746089 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:34.746040 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vhrsj" event={"ID":"c22b3b26-5ab0-4206-aee9-9f10dbe890a1","Type":"ContainerStarted","Data":"e62fbed035e151c0eed1cb2755c2306cf5441bd64d8f16590a33a0c1315494a7"} Jul 21 14:18:34.801677 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:34.801601 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-vhrsj" podStartSLOduration=8.423158554 podStartE2EDuration="41.801579398s" totalImagesPullingTime="33.378420844s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 14:17:53 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:18:34.79970988 +0000 UTC m=+41.817613455" watchObservedRunningTime="2026-07-21 14:18:34.801579398 +0000 UTC m=+41.819483006" Jul 21 14:18:34.805294 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:34.805264 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-d97tp"] Jul 21 14:18:34.827284 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:34.827208 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-g4d47"] Jul 21 14:18:34.827508 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:34.827436 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-d97tp" Jul 21 14:18:34.830751 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:34.830707 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 21 14:18:34.831017 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:34.830861 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rkkbj\"" Jul 21 14:18:34.831017 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:34.830917 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 21 14:18:34.841393 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:34.841358 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-g4d47"] Jul 21 14:18:34.841393 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:34.841401 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-d97tp"] Jul 21 14:18:34.841568 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:34.841484 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-g4d47" Jul 21 14:18:34.844734 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:34.844698 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 21 14:18:34.844734 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:34.844699 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 21 14:18:34.845031 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:34.844841 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 21 14:18:34.845031 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:34.844857 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-s5hdl\"" Jul 21 14:18:35.011057 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:35.011005 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd89fdab-5ed9-4b58-a200-2816c4cf6307-tmp-dir\") pod \"dns-default-d97tp\" (UID: \"bd89fdab-5ed9-4b58-a200-2816c4cf6307\") " pod="openshift-dns/dns-default-d97tp" Jul 21 14:18:35.011273 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:35.011121 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5nmn\" (UniqueName: \"kubernetes.io/projected/bd89fdab-5ed9-4b58-a200-2816c4cf6307-kube-api-access-p5nmn\") pod \"dns-default-d97tp\" (UID: \"bd89fdab-5ed9-4b58-a200-2816c4cf6307\") " pod="openshift-dns/dns-default-d97tp" Jul 21 14:18:35.011273 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:35.011180 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd89fdab-5ed9-4b58-a200-2816c4cf6307-metrics-tls\") pod \"dns-default-d97tp\" (UID: \"bd89fdab-5ed9-4b58-a200-2816c4cf6307\") " pod="openshift-dns/dns-default-d97tp" Jul 21 14:18:35.011273 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:35.011247 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7fbd7107-aae1-4e1a-ab14-7cd5830010b4-cert\") pod \"ingress-canary-g4d47\" (UID: \"7fbd7107-aae1-4e1a-ab14-7cd5830010b4\") " pod="openshift-ingress-canary/ingress-canary-g4d47" Jul 21 14:18:35.011407 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:35.011275 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whg4n\" (UniqueName: \"kubernetes.io/projected/7fbd7107-aae1-4e1a-ab14-7cd5830010b4-kube-api-access-whg4n\") pod \"ingress-canary-g4d47\" (UID: \"7fbd7107-aae1-4e1a-ab14-7cd5830010b4\") " pod="openshift-ingress-canary/ingress-canary-g4d47" Jul 21 14:18:35.011407 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:35.011302 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bd89fdab-5ed9-4b58-a200-2816c4cf6307-config-volume\") pod \"dns-default-d97tp\" (UID: \"bd89fdab-5ed9-4b58-a200-2816c4cf6307\") " pod="openshift-dns/dns-default-d97tp" Jul 21 14:18:35.112319 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:35.112268 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd89fdab-5ed9-4b58-a200-2816c4cf6307-metrics-tls\") pod \"dns-default-d97tp\" (UID: \"bd89fdab-5ed9-4b58-a200-2816c4cf6307\") " pod="openshift-dns/dns-default-d97tp" Jul 21 14:18:35.112319 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:35.112328 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7fbd7107-aae1-4e1a-ab14-7cd5830010b4-cert\") pod \"ingress-canary-g4d47\" (UID: \"7fbd7107-aae1-4e1a-ab14-7cd5830010b4\") " pod="openshift-ingress-canary/ingress-canary-g4d47" Jul 21 14:18:35.112616 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:35.112348 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whg4n\" (UniqueName: \"kubernetes.io/projected/7fbd7107-aae1-4e1a-ab14-7cd5830010b4-kube-api-access-whg4n\") pod \"ingress-canary-g4d47\" (UID: \"7fbd7107-aae1-4e1a-ab14-7cd5830010b4\") " pod="openshift-ingress-canary/ingress-canary-g4d47" Jul 21 14:18:35.112616 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:35.112366 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bd89fdab-5ed9-4b58-a200-2816c4cf6307-config-volume\") pod \"dns-default-d97tp\" (UID: \"bd89fdab-5ed9-4b58-a200-2816c4cf6307\") " pod="openshift-dns/dns-default-d97tp" Jul 21 14:18:35.112616 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:35.112401 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd89fdab-5ed9-4b58-a200-2816c4cf6307-tmp-dir\") pod \"dns-default-d97tp\" (UID: \"bd89fdab-5ed9-4b58-a200-2816c4cf6307\") " pod="openshift-dns/dns-default-d97tp" Jul 21 14:18:35.112616 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:35.112427 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5nmn\" (UniqueName: \"kubernetes.io/projected/bd89fdab-5ed9-4b58-a200-2816c4cf6307-kube-api-access-p5nmn\") pod \"dns-default-d97tp\" (UID: \"bd89fdab-5ed9-4b58-a200-2816c4cf6307\") " pod="openshift-dns/dns-default-d97tp" Jul 21 14:18:35.112947 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:35.112921 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd89fdab-5ed9-4b58-a200-2816c4cf6307-tmp-dir\") pod \"dns-default-d97tp\" (UID: \"bd89fdab-5ed9-4b58-a200-2816c4cf6307\") " pod="openshift-dns/dns-default-d97tp" Jul 21 14:18:35.113074 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:35.113053 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bd89fdab-5ed9-4b58-a200-2816c4cf6307-config-volume\") pod \"dns-default-d97tp\" (UID: \"bd89fdab-5ed9-4b58-a200-2816c4cf6307\") " pod="openshift-dns/dns-default-d97tp" Jul 21 14:18:35.118144 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:35.118104 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd89fdab-5ed9-4b58-a200-2816c4cf6307-metrics-tls\") pod \"dns-default-d97tp\" (UID: \"bd89fdab-5ed9-4b58-a200-2816c4cf6307\") " pod="openshift-dns/dns-default-d97tp" Jul 21 14:18:35.118376 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:35.118123 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7fbd7107-aae1-4e1a-ab14-7cd5830010b4-cert\") pod \"ingress-canary-g4d47\" (UID: \"7fbd7107-aae1-4e1a-ab14-7cd5830010b4\") " pod="openshift-ingress-canary/ingress-canary-g4d47" Jul 21 14:18:35.123272 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:35.123225 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5nmn\" (UniqueName: \"kubernetes.io/projected/bd89fdab-5ed9-4b58-a200-2816c4cf6307-kube-api-access-p5nmn\") pod \"dns-default-d97tp\" (UID: \"bd89fdab-5ed9-4b58-a200-2816c4cf6307\") " pod="openshift-dns/dns-default-d97tp" Jul 21 14:18:35.123480 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:35.123348 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whg4n\" (UniqueName: \"kubernetes.io/projected/7fbd7107-aae1-4e1a-ab14-7cd5830010b4-kube-api-access-whg4n\") pod \"ingress-canary-g4d47\" (UID: \"7fbd7107-aae1-4e1a-ab14-7cd5830010b4\") " pod="openshift-ingress-canary/ingress-canary-g4d47" Jul 21 14:18:35.140133 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:35.140067 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-d97tp" Jul 21 14:18:35.153230 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:35.153184 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-g4d47" Jul 21 14:18:35.365218 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:35.365180 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-d97tp"] Jul 21 14:18:35.369583 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:18:35.369548 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd89fdab_5ed9_4b58_a200_2816c4cf6307.slice/crio-fbfd4e955963be6d70b60bd692b725fb7630a02c6e3e4e893c8c42a75a5ed302 WatchSource:0}: Error finding container fbfd4e955963be6d70b60bd692b725fb7630a02c6e3e4e893c8c42a75a5ed302: Status 404 returned error can't find the container with id fbfd4e955963be6d70b60bd692b725fb7630a02c6e3e4e893c8c42a75a5ed302 Jul 21 14:18:35.377724 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:35.377691 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-g4d47"] Jul 21 14:18:35.381094 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:18:35.381064 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fbd7107_aae1_4e1a_ab14_7cd5830010b4.slice/crio-41bbbc25aa7d4fb3f4bf81f54272403eb1c9b63f6b22c0b3c957e1dab0cfbee5 WatchSource:0}: Error finding container 41bbbc25aa7d4fb3f4bf81f54272403eb1c9b63f6b22c0b3c957e1dab0cfbee5: Status 404 returned error can't find the container with id 41bbbc25aa7d4fb3f4bf81f54272403eb1c9b63f6b22c0b3c957e1dab0cfbee5 Jul 21 14:18:35.750537 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:35.750483 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-g4d47" event={"ID":"7fbd7107-aae1-4e1a-ab14-7cd5830010b4","Type":"ContainerStarted","Data":"41bbbc25aa7d4fb3f4bf81f54272403eb1c9b63f6b22c0b3c957e1dab0cfbee5"} Jul 21 14:18:35.752001 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:35.751957 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-d97tp" event={"ID":"bd89fdab-5ed9-4b58-a200-2816c4cf6307","Type":"ContainerStarted","Data":"fbfd4e955963be6d70b60bd692b725fb7630a02c6e3e4e893c8c42a75a5ed302"} Jul 21 14:18:36.520088 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:36.520032 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9tpq5" Jul 21 14:18:36.520088 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:36.520069 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fttn7" Jul 21 14:18:36.520088 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:36.520032 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4r4d6" Jul 21 14:18:36.525226 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:36.524736 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 21 14:18:36.525226 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:36.524854 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qcck5\"" Jul 21 14:18:36.525226 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:36.524736 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2kbnq\"" Jul 21 14:18:36.525226 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:36.524737 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 21 14:18:36.525226 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:36.524859 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 21 14:18:36.525706 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:36.525325 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 21 14:18:38.764461 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:38.764409 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-g4d47" event={"ID":"7fbd7107-aae1-4e1a-ab14-7cd5830010b4","Type":"ContainerStarted","Data":"ae47d235c8d130de10ac6149d8d73a226ffa9551e743c03b69f16175cd6f68d3"} Jul 21 14:18:38.767112 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:38.767046 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-d97tp" event={"ID":"bd89fdab-5ed9-4b58-a200-2816c4cf6307","Type":"ContainerStarted","Data":"ee301d7e2192033e240d5375dafbe963c95a6f0069e001fe9a401dff54eaf67f"} Jul 21 14:18:38.789889 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:38.789689 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-g4d47" podStartSLOduration=1.654547218 podStartE2EDuration="4.789653942s" totalImagesPullingTime="3.135106724s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:18:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:18:38.788770192 +0000 UTC m=+45.806673766" watchObservedRunningTime="2026-07-21 14:18:38.789653942 +0000 UTC m=+45.807557498" Jul 21 14:18:39.253165 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:39.253118 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-c25fw"] Jul 21 14:18:39.265682 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:39.265644 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-c25fw" Jul 21 14:18:39.268673 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:39.268637 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 21 14:18:39.269087 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:39.268645 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-c25fw"] Jul 21 14:18:39.269087 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:39.268855 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-sssdx\"" Jul 21 14:18:39.350134 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:39.350088 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7be8e2df-8100-4d6b-8cfe-b578b5199099-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-c25fw\" (UID: \"7be8e2df-8100-4d6b-8cfe-b578b5199099\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-c25fw" Jul 21 14:18:39.450565 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:39.450516 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7be8e2df-8100-4d6b-8cfe-b578b5199099-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-c25fw\" (UID: \"7be8e2df-8100-4d6b-8cfe-b578b5199099\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-c25fw" Jul 21 14:18:39.450880 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:39.450708 2576 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 21 14:18:39.450880 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:39.450841 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7be8e2df-8100-4d6b-8cfe-b578b5199099-tls-certificates podName:7be8e2df-8100-4d6b-8cfe-b578b5199099 nodeName:}" failed. No retries permitted until 2026-07-21 14:18:39.950803589 +0000 UTC m=+46.968707158 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/7be8e2df-8100-4d6b-8cfe-b578b5199099-tls-certificates") pod "prometheus-operator-admission-webhook-85574b5f49-c25fw" (UID: "7be8e2df-8100-4d6b-8cfe-b578b5199099") : secret "prometheus-operator-admission-webhook-tls" not found Jul 21 14:18:39.712097 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:39.711865 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-zrtj8"] Jul 21 14:18:39.746755 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:39.746705 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zrtj8" Jul 21 14:18:39.754449 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:39.754189 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 21 14:18:39.755478 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:39.755447 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 21 14:18:39.755701 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:39.755447 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-m7grf\"" Jul 21 14:18:39.761009 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:39.760979 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 21 14:18:39.766528 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:39.766470 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zrtj8"] Jul 21 14:18:39.768771 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:39.768713 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 21 14:18:39.778063 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:39.778017 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-d97tp" event={"ID":"bd89fdab-5ed9-4b58-a200-2816c4cf6307","Type":"ContainerStarted","Data":"058b8120ed12c53153d2b79a339e334237bfd01bf5f78df797c67bbb670da779"} Jul 21 14:18:39.778298 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:39.778169 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-d97tp" Jul 21 14:18:39.780240 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:39.780203 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-dwdzd"] Jul 21 14:18:39.800717 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:39.800680 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-dwdzd" Jul 21 14:18:39.804067 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:39.804036 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-v7w6x\"" Jul 21 14:18:39.805259 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:39.805221 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 21 14:18:39.805470 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:39.805234 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 21 14:18:39.805585 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:39.805560 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-dwdzd"] Jul 21 14:18:39.828338 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:39.828211 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-d97tp" podStartSLOduration=2.68954428 podStartE2EDuration="5.828183048s" totalImagesPullingTime="3.138638768s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:18:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:18:39.827357683 +0000 UTC m=+46.845261256" watchObservedRunningTime="2026-07-21 14:18:39.828183048 +0000 UTC m=+46.846086619" Jul 21 14:18:39.854009 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:39.853959 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6c7af6c4-9136-4fbe-a126-fb15ac1b568f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zrtj8\" (UID: \"6c7af6c4-9136-4fbe-a126-fb15ac1b568f\") " pod="openshift-insights/insights-runtime-extractor-zrtj8" Jul 21 14:18:39.854233 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:39.854054 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6c7af6c4-9136-4fbe-a126-fb15ac1b568f-data-volume\") pod \"insights-runtime-extractor-zrtj8\" (UID: \"6c7af6c4-9136-4fbe-a126-fb15ac1b568f\") " pod="openshift-insights/insights-runtime-extractor-zrtj8" Jul 21 14:18:39.854233 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:39.854199 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8k89\" (UniqueName: \"kubernetes.io/projected/6c7af6c4-9136-4fbe-a126-fb15ac1b568f-kube-api-access-k8k89\") pod \"insights-runtime-extractor-zrtj8\" (UID: \"6c7af6c4-9136-4fbe-a126-fb15ac1b568f\") " pod="openshift-insights/insights-runtime-extractor-zrtj8" Jul 21 14:18:39.854339 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:39.854266 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6c7af6c4-9136-4fbe-a126-fb15ac1b568f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zrtj8\" (UID: \"6c7af6c4-9136-4fbe-a126-fb15ac1b568f\") " pod="openshift-insights/insights-runtime-extractor-zrtj8" Jul 21 14:18:39.854389 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:39.854350 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6c7af6c4-9136-4fbe-a126-fb15ac1b568f-crio-socket\") pod \"insights-runtime-extractor-zrtj8\" (UID: \"6c7af6c4-9136-4fbe-a126-fb15ac1b568f\") " pod="openshift-insights/insights-runtime-extractor-zrtj8" Jul 21 14:18:39.854389 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:39.854383 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2srzc\" (UniqueName: \"kubernetes.io/projected/7ab873ea-a45a-4aae-93ec-54ce3552389d-kube-api-access-2srzc\") pod \"downloads-5bc67dcd46-dwdzd\" (UID: \"7ab873ea-a45a-4aae-93ec-54ce3552389d\") " pod="openshift-console/downloads-5bc67dcd46-dwdzd" Jul 21 14:18:39.955397 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:39.955349 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6c7af6c4-9136-4fbe-a126-fb15ac1b568f-crio-socket\") pod \"insights-runtime-extractor-zrtj8\" (UID: \"6c7af6c4-9136-4fbe-a126-fb15ac1b568f\") " pod="openshift-insights/insights-runtime-extractor-zrtj8" Jul 21 14:18:39.955397 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:39.955393 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2srzc\" (UniqueName: \"kubernetes.io/projected/7ab873ea-a45a-4aae-93ec-54ce3552389d-kube-api-access-2srzc\") pod \"downloads-5bc67dcd46-dwdzd\" (UID: \"7ab873ea-a45a-4aae-93ec-54ce3552389d\") " pod="openshift-console/downloads-5bc67dcd46-dwdzd" Jul 21 14:18:39.955632 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:39.955553 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7be8e2df-8100-4d6b-8cfe-b578b5199099-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-c25fw\" (UID: \"7be8e2df-8100-4d6b-8cfe-b578b5199099\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-c25fw" Jul 21 14:18:39.955632 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:39.955568 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6c7af6c4-9136-4fbe-a126-fb15ac1b568f-crio-socket\") pod \"insights-runtime-extractor-zrtj8\" (UID: \"6c7af6c4-9136-4fbe-a126-fb15ac1b568f\") " pod="openshift-insights/insights-runtime-extractor-zrtj8" Jul 21 14:18:39.955632 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:39.955589 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6c7af6c4-9136-4fbe-a126-fb15ac1b568f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zrtj8\" (UID: \"6c7af6c4-9136-4fbe-a126-fb15ac1b568f\") " pod="openshift-insights/insights-runtime-extractor-zrtj8" Jul 21 14:18:39.955632 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:39.955623 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6c7af6c4-9136-4fbe-a126-fb15ac1b568f-data-volume\") pod \"insights-runtime-extractor-zrtj8\" (UID: \"6c7af6c4-9136-4fbe-a126-fb15ac1b568f\") " pod="openshift-insights/insights-runtime-extractor-zrtj8" Jul 21 14:18:39.955765 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:39.955654 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8k89\" (UniqueName: \"kubernetes.io/projected/6c7af6c4-9136-4fbe-a126-fb15ac1b568f-kube-api-access-k8k89\") pod \"insights-runtime-extractor-zrtj8\" (UID: \"6c7af6c4-9136-4fbe-a126-fb15ac1b568f\") " pod="openshift-insights/insights-runtime-extractor-zrtj8" Jul 21 14:18:39.955765 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:39.955712 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6c7af6c4-9136-4fbe-a126-fb15ac1b568f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zrtj8\" (UID: \"6c7af6c4-9136-4fbe-a126-fb15ac1b568f\") " pod="openshift-insights/insights-runtime-extractor-zrtj8" Jul 21 14:18:39.955875 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:39.955826 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 21 14:18:39.955875 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:39.955852 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 21 14:18:39.955936 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:39.955891 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6c7af6c4-9136-4fbe-a126-fb15ac1b568f-kube-rbac-proxy-cm podName:6c7af6c4-9136-4fbe-a126-fb15ac1b568f nodeName:}" failed. No retries permitted until 2026-07-21 14:18:40.4558718 +0000 UTC m=+47.473775360 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6c7af6c4-9136-4fbe-a126-fb15ac1b568f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zrtj8" (UID: "6c7af6c4-9136-4fbe-a126-fb15ac1b568f") : configmap "kube-rbac-proxy" not found Jul 21 14:18:39.955936 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:39.955918 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c7af6c4-9136-4fbe-a126-fb15ac1b568f-insights-runtime-extractor-tls podName:6c7af6c4-9136-4fbe-a126-fb15ac1b568f nodeName:}" failed. No retries permitted until 2026-07-21 14:18:40.455896867 +0000 UTC m=+47.473800449 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6c7af6c4-9136-4fbe-a126-fb15ac1b568f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zrtj8" (UID: "6c7af6c4-9136-4fbe-a126-fb15ac1b568f") : secret "insights-runtime-extractor-tls" not found Jul 21 14:18:39.956013 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:39.955956 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6c7af6c4-9136-4fbe-a126-fb15ac1b568f-data-volume\") pod \"insights-runtime-extractor-zrtj8\" (UID: \"6c7af6c4-9136-4fbe-a126-fb15ac1b568f\") " pod="openshift-insights/insights-runtime-extractor-zrtj8" Jul 21 14:18:39.958234 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:39.958211 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7be8e2df-8100-4d6b-8cfe-b578b5199099-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-c25fw\" (UID: \"7be8e2df-8100-4d6b-8cfe-b578b5199099\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-c25fw" Jul 21 14:18:39.974579 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:39.974498 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2srzc\" (UniqueName: \"kubernetes.io/projected/7ab873ea-a45a-4aae-93ec-54ce3552389d-kube-api-access-2srzc\") pod \"downloads-5bc67dcd46-dwdzd\" (UID: \"7ab873ea-a45a-4aae-93ec-54ce3552389d\") " pod="openshift-console/downloads-5bc67dcd46-dwdzd" Jul 21 14:18:39.974579 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:39.974498 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8k89\" (UniqueName: \"kubernetes.io/projected/6c7af6c4-9136-4fbe-a126-fb15ac1b568f-kube-api-access-k8k89\") pod \"insights-runtime-extractor-zrtj8\" (UID: \"6c7af6c4-9136-4fbe-a126-fb15ac1b568f\") " pod="openshift-insights/insights-runtime-extractor-zrtj8" Jul 21 14:18:40.112710 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:40.112640 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-dwdzd" Jul 21 14:18:40.177391 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:40.177341 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-c25fw" Jul 21 14:18:40.310691 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:40.310031 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-dwdzd"] Jul 21 14:18:40.312234 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:18:40.312210 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ab873ea_a45a_4aae_93ec_54ce3552389d.slice/crio-65633bdfd8b806dde30a54ad9787ed2f5d3deb80a5527756606cf3a6e70b6b20 WatchSource:0}: Error finding container 65633bdfd8b806dde30a54ad9787ed2f5d3deb80a5527756606cf3a6e70b6b20: Status 404 returned error can't find the container with id 65633bdfd8b806dde30a54ad9787ed2f5d3deb80a5527756606cf3a6e70b6b20 Jul 21 14:18:40.344151 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:40.344132 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-c25fw"] Jul 21 14:18:40.346587 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:18:40.346565 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7be8e2df_8100_4d6b_8cfe_b578b5199099.slice/crio-cb9f47de7fb1b716b243a6d4ae55d81c1d2a2e9994fdfbefb25aa3852829aecc WatchSource:0}: Error finding container cb9f47de7fb1b716b243a6d4ae55d81c1d2a2e9994fdfbefb25aa3852829aecc: Status 404 returned error can't find the container with id cb9f47de7fb1b716b243a6d4ae55d81c1d2a2e9994fdfbefb25aa3852829aecc Jul 21 14:18:40.459982 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:40.459960 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6c7af6c4-9136-4fbe-a126-fb15ac1b568f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zrtj8\" (UID: \"6c7af6c4-9136-4fbe-a126-fb15ac1b568f\") " pod="openshift-insights/insights-runtime-extractor-zrtj8" Jul 21 14:18:40.460079 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:40.460002 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6c7af6c4-9136-4fbe-a126-fb15ac1b568f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zrtj8\" (UID: \"6c7af6c4-9136-4fbe-a126-fb15ac1b568f\") " pod="openshift-insights/insights-runtime-extractor-zrtj8" Jul 21 14:18:40.460121 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:40.460084 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 21 14:18:40.460121 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:40.460102 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 21 14:18:40.460180 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:40.460131 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6c7af6c4-9136-4fbe-a126-fb15ac1b568f-kube-rbac-proxy-cm podName:6c7af6c4-9136-4fbe-a126-fb15ac1b568f nodeName:}" failed. No retries permitted until 2026-07-21 14:18:41.460116668 +0000 UTC m=+48.478020220 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6c7af6c4-9136-4fbe-a126-fb15ac1b568f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zrtj8" (UID: "6c7af6c4-9136-4fbe-a126-fb15ac1b568f") : configmap "kube-rbac-proxy" not found Jul 21 14:18:40.460180 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:40.460148 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c7af6c4-9136-4fbe-a126-fb15ac1b568f-insights-runtime-extractor-tls podName:6c7af6c4-9136-4fbe-a126-fb15ac1b568f nodeName:}" failed. No retries permitted until 2026-07-21 14:18:41.460135998 +0000 UTC m=+48.478039551 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6c7af6c4-9136-4fbe-a126-fb15ac1b568f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zrtj8" (UID: "6c7af6c4-9136-4fbe-a126-fb15ac1b568f") : secret "insights-runtime-extractor-tls" not found Jul 21 14:18:40.658498 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:40.658439 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-d97tp_bd89fdab-5ed9-4b58-a200-2816c4cf6307/dns/0.log" Jul 21 14:18:40.781264 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:40.781237 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-c25fw" event={"ID":"7be8e2df-8100-4d6b-8cfe-b578b5199099","Type":"ContainerStarted","Data":"cb9f47de7fb1b716b243a6d4ae55d81c1d2a2e9994fdfbefb25aa3852829aecc"} Jul 21 14:18:40.782426 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:40.782408 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-dwdzd" event={"ID":"7ab873ea-a45a-4aae-93ec-54ce3552389d","Type":"ContainerStarted","Data":"65633bdfd8b806dde30a54ad9787ed2f5d3deb80a5527756606cf3a6e70b6b20"} Jul 21 14:18:40.829821 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:40.829799 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-d97tp_bd89fdab-5ed9-4b58-a200-2816c4cf6307/kube-rbac-proxy/0.log" Jul 21 14:18:41.429007 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:41.428978 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-b5kkg_08737a2e-4e32-441c-b905-c2a2e41b1d17/dns-node-resolver/0.log" Jul 21 14:18:41.468009 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:41.467983 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6c7af6c4-9136-4fbe-a126-fb15ac1b568f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zrtj8\" (UID: \"6c7af6c4-9136-4fbe-a126-fb15ac1b568f\") " pod="openshift-insights/insights-runtime-extractor-zrtj8" Jul 21 14:18:41.468137 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:41.468047 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6c7af6c4-9136-4fbe-a126-fb15ac1b568f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zrtj8\" (UID: \"6c7af6c4-9136-4fbe-a126-fb15ac1b568f\") " pod="openshift-insights/insights-runtime-extractor-zrtj8" Jul 21 14:18:41.468137 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:41.468099 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 21 14:18:41.468208 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:41.468140 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 21 14:18:41.468208 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:41.468161 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6c7af6c4-9136-4fbe-a126-fb15ac1b568f-kube-rbac-proxy-cm podName:6c7af6c4-9136-4fbe-a126-fb15ac1b568f nodeName:}" failed. No retries permitted until 2026-07-21 14:18:43.468146022 +0000 UTC m=+50.486049578 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6c7af6c4-9136-4fbe-a126-fb15ac1b568f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zrtj8" (UID: "6c7af6c4-9136-4fbe-a126-fb15ac1b568f") : configmap "kube-rbac-proxy" not found Jul 21 14:18:41.468208 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:18:41.468180 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c7af6c4-9136-4fbe-a126-fb15ac1b568f-insights-runtime-extractor-tls podName:6c7af6c4-9136-4fbe-a126-fb15ac1b568f nodeName:}" failed. No retries permitted until 2026-07-21 14:18:43.468168249 +0000 UTC m=+50.486071822 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6c7af6c4-9136-4fbe-a126-fb15ac1b568f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zrtj8" (UID: "6c7af6c4-9136-4fbe-a126-fb15ac1b568f") : secret "insights-runtime-extractor-tls" not found Jul 21 14:18:43.032243 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:43.032218 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nxm5s_8ccfca56-0054-4006-be8c-2fb53147addd/node-ca/0.log" Jul 21 14:18:43.430136 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:43.430031 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-g4d47_7fbd7107-aae1-4e1a-ab14-7cd5830010b4/serve-healthcheck-canary/0.log" Jul 21 14:18:43.485046 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:43.485001 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6c7af6c4-9136-4fbe-a126-fb15ac1b568f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zrtj8\" (UID: \"6c7af6c4-9136-4fbe-a126-fb15ac1b568f\") " pod="openshift-insights/insights-runtime-extractor-zrtj8" Jul 21 14:18:43.485287 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:43.485064 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6c7af6c4-9136-4fbe-a126-fb15ac1b568f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zrtj8\" (UID: \"6c7af6c4-9136-4fbe-a126-fb15ac1b568f\") " pod="openshift-insights/insights-runtime-extractor-zrtj8" Jul 21 14:18:43.485652 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:43.485616 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6c7af6c4-9136-4fbe-a126-fb15ac1b568f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zrtj8\" (UID: \"6c7af6c4-9136-4fbe-a126-fb15ac1b568f\") " pod="openshift-insights/insights-runtime-extractor-zrtj8" Jul 21 14:18:43.490165 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:43.488877 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6c7af6c4-9136-4fbe-a126-fb15ac1b568f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zrtj8\" (UID: \"6c7af6c4-9136-4fbe-a126-fb15ac1b568f\") " pod="openshift-insights/insights-runtime-extractor-zrtj8" Jul 21 14:18:43.658367 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:43.658289 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zrtj8" Jul 21 14:18:43.842033 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:43.841981 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zrtj8"] Jul 21 14:18:43.846560 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:18:43.846510 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c7af6c4_9136_4fbe_a126_fb15ac1b568f.slice/crio-53abc49ee127d7d538053dd74be7417e0bd1cfd80bd3848dab259ba7999ec452 WatchSource:0}: Error finding container 53abc49ee127d7d538053dd74be7417e0bd1cfd80bd3848dab259ba7999ec452: Status 404 returned error can't find the container with id 53abc49ee127d7d538053dd74be7417e0bd1cfd80bd3848dab259ba7999ec452 Jul 21 14:18:44.799277 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:44.799205 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zrtj8" event={"ID":"6c7af6c4-9136-4fbe-a126-fb15ac1b568f","Type":"ContainerStarted","Data":"53abc49ee127d7d538053dd74be7417e0bd1cfd80bd3848dab259ba7999ec452"} Jul 21 14:18:45.212423 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:45.210963 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7d7fd86b9-cgfcm"] Jul 21 14:18:45.232288 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:45.232172 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d7fd86b9-cgfcm"] Jul 21 14:18:45.232585 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:45.232404 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d7fd86b9-cgfcm" Jul 21 14:18:45.241084 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:45.241016 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 21 14:18:45.241566 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:45.241542 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 21 14:18:45.241907 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:45.241882 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-br6h4\"" Jul 21 14:18:45.243906 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:45.242393 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 21 14:18:45.243906 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:45.242641 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 21 14:18:45.243906 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:45.243809 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 21 14:18:45.301568 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:45.301526 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b77c139b-0a19-449b-91ee-72bb56be84ff-oauth-serving-cert\") pod \"console-7d7fd86b9-cgfcm\" (UID: \"b77c139b-0a19-449b-91ee-72bb56be84ff\") " pod="openshift-console/console-7d7fd86b9-cgfcm" Jul 21 14:18:45.301755 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:45.301629 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b77c139b-0a19-449b-91ee-72bb56be84ff-console-config\") pod \"console-7d7fd86b9-cgfcm\" (UID: \"b77c139b-0a19-449b-91ee-72bb56be84ff\") " pod="openshift-console/console-7d7fd86b9-cgfcm" Jul 21 14:18:45.301755 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:45.301682 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b77c139b-0a19-449b-91ee-72bb56be84ff-console-serving-cert\") pod \"console-7d7fd86b9-cgfcm\" (UID: \"b77c139b-0a19-449b-91ee-72bb56be84ff\") " pod="openshift-console/console-7d7fd86b9-cgfcm" Jul 21 14:18:45.301755 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:45.301704 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b77c139b-0a19-449b-91ee-72bb56be84ff-console-oauth-config\") pod \"console-7d7fd86b9-cgfcm\" (UID: \"b77c139b-0a19-449b-91ee-72bb56be84ff\") " pod="openshift-console/console-7d7fd86b9-cgfcm" Jul 21 14:18:45.301755 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:45.301748 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-879g4\" (UniqueName: \"kubernetes.io/projected/b77c139b-0a19-449b-91ee-72bb56be84ff-kube-api-access-879g4\") pod \"console-7d7fd86b9-cgfcm\" (UID: \"b77c139b-0a19-449b-91ee-72bb56be84ff\") " pod="openshift-console/console-7d7fd86b9-cgfcm" Jul 21 14:18:45.301989 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:45.301802 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b77c139b-0a19-449b-91ee-72bb56be84ff-service-ca\") pod \"console-7d7fd86b9-cgfcm\" (UID: \"b77c139b-0a19-449b-91ee-72bb56be84ff\") " pod="openshift-console/console-7d7fd86b9-cgfcm" Jul 21 14:18:45.402949 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:45.402900 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b77c139b-0a19-449b-91ee-72bb56be84ff-console-serving-cert\") pod \"console-7d7fd86b9-cgfcm\" (UID: \"b77c139b-0a19-449b-91ee-72bb56be84ff\") " pod="openshift-console/console-7d7fd86b9-cgfcm" Jul 21 14:18:45.403207 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:45.402960 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b77c139b-0a19-449b-91ee-72bb56be84ff-console-oauth-config\") pod \"console-7d7fd86b9-cgfcm\" (UID: \"b77c139b-0a19-449b-91ee-72bb56be84ff\") " pod="openshift-console/console-7d7fd86b9-cgfcm" Jul 21 14:18:45.403207 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:45.403003 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-879g4\" (UniqueName: \"kubernetes.io/projected/b77c139b-0a19-449b-91ee-72bb56be84ff-kube-api-access-879g4\") pod \"console-7d7fd86b9-cgfcm\" (UID: \"b77c139b-0a19-449b-91ee-72bb56be84ff\") " pod="openshift-console/console-7d7fd86b9-cgfcm" Jul 21 14:18:45.403207 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:45.403040 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b77c139b-0a19-449b-91ee-72bb56be84ff-service-ca\") pod \"console-7d7fd86b9-cgfcm\" (UID: \"b77c139b-0a19-449b-91ee-72bb56be84ff\") " pod="openshift-console/console-7d7fd86b9-cgfcm" Jul 21 14:18:45.403207 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:45.403084 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b77c139b-0a19-449b-91ee-72bb56be84ff-oauth-serving-cert\") pod \"console-7d7fd86b9-cgfcm\" (UID: \"b77c139b-0a19-449b-91ee-72bb56be84ff\") " pod="openshift-console/console-7d7fd86b9-cgfcm" Jul 21 14:18:45.403207 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:45.403133 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b77c139b-0a19-449b-91ee-72bb56be84ff-console-config\") pod \"console-7d7fd86b9-cgfcm\" (UID: \"b77c139b-0a19-449b-91ee-72bb56be84ff\") " pod="openshift-console/console-7d7fd86b9-cgfcm" Jul 21 14:18:45.404065 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:45.404006 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b77c139b-0a19-449b-91ee-72bb56be84ff-console-config\") pod \"console-7d7fd86b9-cgfcm\" (UID: \"b77c139b-0a19-449b-91ee-72bb56be84ff\") " pod="openshift-console/console-7d7fd86b9-cgfcm" Jul 21 14:18:45.404452 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:45.404213 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b77c139b-0a19-449b-91ee-72bb56be84ff-service-ca\") pod \"console-7d7fd86b9-cgfcm\" (UID: \"b77c139b-0a19-449b-91ee-72bb56be84ff\") " pod="openshift-console/console-7d7fd86b9-cgfcm" Jul 21 14:18:45.404563 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:45.404462 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b77c139b-0a19-449b-91ee-72bb56be84ff-oauth-serving-cert\") pod \"console-7d7fd86b9-cgfcm\" (UID: \"b77c139b-0a19-449b-91ee-72bb56be84ff\") " pod="openshift-console/console-7d7fd86b9-cgfcm" Jul 21 14:18:45.407371 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:45.407302 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b77c139b-0a19-449b-91ee-72bb56be84ff-console-serving-cert\") pod \"console-7d7fd86b9-cgfcm\" (UID: \"b77c139b-0a19-449b-91ee-72bb56be84ff\") " pod="openshift-console/console-7d7fd86b9-cgfcm" Jul 21 14:18:45.407941 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:45.407913 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b77c139b-0a19-449b-91ee-72bb56be84ff-console-oauth-config\") pod \"console-7d7fd86b9-cgfcm\" (UID: \"b77c139b-0a19-449b-91ee-72bb56be84ff\") " pod="openshift-console/console-7d7fd86b9-cgfcm" Jul 21 14:18:45.420091 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:45.420004 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-879g4\" (UniqueName: \"kubernetes.io/projected/b77c139b-0a19-449b-91ee-72bb56be84ff-kube-api-access-879g4\") pod \"console-7d7fd86b9-cgfcm\" (UID: \"b77c139b-0a19-449b-91ee-72bb56be84ff\") " pod="openshift-console/console-7d7fd86b9-cgfcm" Jul 21 14:18:45.555303 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:45.555253 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d7fd86b9-cgfcm" Jul 21 14:18:45.899943 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:45.899890 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d7fd86b9-cgfcm"] Jul 21 14:18:45.908138 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:18:45.908086 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb77c139b_0a19_449b_91ee_72bb56be84ff.slice/crio-0d3e226a8151dc1c0f5e5e9eebd069be1fd024e45294649e9e333e415db213ae WatchSource:0}: Error finding container 0d3e226a8151dc1c0f5e5e9eebd069be1fd024e45294649e9e333e415db213ae: Status 404 returned error can't find the container with id 0d3e226a8151dc1c0f5e5e9eebd069be1fd024e45294649e9e333e415db213ae Jul 21 14:18:46.808172 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:46.808124 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d7fd86b9-cgfcm" event={"ID":"b77c139b-0a19-449b-91ee-72bb56be84ff","Type":"ContainerStarted","Data":"0d3e226a8151dc1c0f5e5e9eebd069be1fd024e45294649e9e333e415db213ae"} Jul 21 14:18:46.810541 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:46.810510 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-c25fw" event={"ID":"7be8e2df-8100-4d6b-8cfe-b578b5199099","Type":"ContainerStarted","Data":"7672647451f7833ed88016f746cbd20724552fba8fdf8f0662170a40ce5339e6"} Jul 21 14:18:46.811192 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:46.811171 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-c25fw" Jul 21 14:18:46.816939 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:46.816917 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-c25fw" Jul 21 14:18:46.834394 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:46.833978 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-c25fw" podStartSLOduration=2.454712692 podStartE2EDuration="7.833944308s" totalImagesPullingTime="5.379231616s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:18:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:18:46.833880511 +0000 UTC m=+53.851784085" watchObservedRunningTime="2026-07-21 14:18:46.833944308 +0000 UTC m=+53.851847882" Jul 21 14:18:47.434286 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:47.433493 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-tdgzg"] Jul 21 14:18:47.518679 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:47.518576 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-tdgzg"] Jul 21 14:18:47.518995 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:47.518737 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-tdgzg" Jul 21 14:18:47.523805 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:47.523722 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 21 14:18:47.524039 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:47.523880 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 21 14:18:47.524268 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:47.524245 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-rwsmr\"" Jul 21 14:18:47.524615 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:47.524418 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 21 14:18:47.524615 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:47.524612 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 21 14:18:47.524887 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:47.524762 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 21 14:18:47.625416 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:47.625160 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gp5xw\" (UniqueName: \"kubernetes.io/projected/cbf75b07-d001-4306-b1c4-739f89f1ddf5-kube-api-access-gp5xw\") pod \"prometheus-operator-5945b5cfd-tdgzg\" (UID: \"cbf75b07-d001-4306-b1c4-739f89f1ddf5\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-tdgzg" Jul 21 14:18:47.625416 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:47.625226 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cbf75b07-d001-4306-b1c4-739f89f1ddf5-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-tdgzg\" (UID: \"cbf75b07-d001-4306-b1c4-739f89f1ddf5\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-tdgzg" Jul 21 14:18:47.625416 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:47.625271 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cbf75b07-d001-4306-b1c4-739f89f1ddf5-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-tdgzg\" (UID: \"cbf75b07-d001-4306-b1c4-739f89f1ddf5\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-tdgzg" Jul 21 14:18:47.625416 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:47.625307 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/cbf75b07-d001-4306-b1c4-739f89f1ddf5-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-tdgzg\" (UID: \"cbf75b07-d001-4306-b1c4-739f89f1ddf5\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-tdgzg" Jul 21 14:18:47.726374 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:47.726280 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gp5xw\" (UniqueName: \"kubernetes.io/projected/cbf75b07-d001-4306-b1c4-739f89f1ddf5-kube-api-access-gp5xw\") pod \"prometheus-operator-5945b5cfd-tdgzg\" (UID: \"cbf75b07-d001-4306-b1c4-739f89f1ddf5\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-tdgzg" Jul 21 14:18:47.726374 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:47.726341 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cbf75b07-d001-4306-b1c4-739f89f1ddf5-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-tdgzg\" (UID: \"cbf75b07-d001-4306-b1c4-739f89f1ddf5\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-tdgzg" Jul 21 14:18:47.726619 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:47.726401 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cbf75b07-d001-4306-b1c4-739f89f1ddf5-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-tdgzg\" (UID: \"cbf75b07-d001-4306-b1c4-739f89f1ddf5\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-tdgzg" Jul 21 14:18:47.726619 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:47.726446 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/cbf75b07-d001-4306-b1c4-739f89f1ddf5-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-tdgzg\" (UID: \"cbf75b07-d001-4306-b1c4-739f89f1ddf5\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-tdgzg" Jul 21 14:18:47.727677 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:47.727616 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cbf75b07-d001-4306-b1c4-739f89f1ddf5-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-tdgzg\" (UID: \"cbf75b07-d001-4306-b1c4-739f89f1ddf5\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-tdgzg" Jul 21 14:18:47.729684 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:47.729617 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/cbf75b07-d001-4306-b1c4-739f89f1ddf5-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-tdgzg\" (UID: \"cbf75b07-d001-4306-b1c4-739f89f1ddf5\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-tdgzg" Jul 21 14:18:47.730401 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:47.730345 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cbf75b07-d001-4306-b1c4-739f89f1ddf5-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-tdgzg\" (UID: \"cbf75b07-d001-4306-b1c4-739f89f1ddf5\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-tdgzg" Jul 21 14:18:47.739585 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:47.739495 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gp5xw\" (UniqueName: \"kubernetes.io/projected/cbf75b07-d001-4306-b1c4-739f89f1ddf5-kube-api-access-gp5xw\") pod \"prometheus-operator-5945b5cfd-tdgzg\" (UID: \"cbf75b07-d001-4306-b1c4-739f89f1ddf5\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-tdgzg" Jul 21 14:18:47.837762 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:47.837695 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-tdgzg" Jul 21 14:18:49.786164 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:49.786115 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-d97tp" Jul 21 14:18:51.667492 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:51.667377 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-tdgzg"] Jul 21 14:18:51.671895 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:18:51.671856 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbf75b07_d001_4306_b1c4_739f89f1ddf5.slice/crio-d9d3bb8e0bdb60a3fbd86cbc1fd7a6568228548978db62b1e6af1933513bf635 WatchSource:0}: Error finding container d9d3bb8e0bdb60a3fbd86cbc1fd7a6568228548978db62b1e6af1933513bf635: Status 404 returned error can't find the container with id d9d3bb8e0bdb60a3fbd86cbc1fd7a6568228548978db62b1e6af1933513bf635 Jul 21 14:18:51.842008 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:51.841539 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d7fd86b9-cgfcm" event={"ID":"b77c139b-0a19-449b-91ee-72bb56be84ff","Type":"ContainerStarted","Data":"772acdbf48fae081e1f831313cd2069df0e52bf81bb32a4c3b3b818ac256eca9"} Jul 21 14:18:51.843809 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:51.843713 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-tdgzg" event={"ID":"cbf75b07-d001-4306-b1c4-739f89f1ddf5","Type":"ContainerStarted","Data":"d9d3bb8e0bdb60a3fbd86cbc1fd7a6568228548978db62b1e6af1933513bf635"} Jul 21 14:18:51.846145 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:51.846089 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zrtj8" event={"ID":"6c7af6c4-9136-4fbe-a126-fb15ac1b568f","Type":"ContainerStarted","Data":"ab11575c805743214e7f92a77dc4b85ee4d0da4b58a45708be99b19dcad96103"} Jul 21 14:18:51.865990 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:51.865882 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7d7fd86b9-cgfcm" podStartSLOduration=1.287212608 podStartE2EDuration="6.865846127s" totalImagesPullingTime="5.578633519s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:18:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:18:51.865254879 +0000 UTC m=+58.883158455" watchObservedRunningTime="2026-07-21 14:18:51.865846127 +0000 UTC m=+58.883749704" Jul 21 14:18:55.556831 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:55.556740 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7d7fd86b9-cgfcm" Jul 21 14:18:55.557529 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:55.556881 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7d7fd86b9-cgfcm" Jul 21 14:18:55.564135 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:55.564075 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7d7fd86b9-cgfcm" Jul 21 14:18:55.723653 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:55.723587 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-c4p99" Jul 21 14:18:55.869166 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:55.869083 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7d7fd86b9-cgfcm" Jul 21 14:18:59.147107 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:59.147047 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f208bc8d-9c6c-4dc0-a7e3-a95c9e26c3d6-metrics-certs\") pod \"network-metrics-daemon-9tpq5\" (UID: \"f208bc8d-9c6c-4dc0-a7e3-a95c9e26c3d6\") " pod="openshift-multus/network-metrics-daemon-9tpq5" Jul 21 14:18:59.150189 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:59.150151 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 21 14:18:59.160792 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:59.160738 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f208bc8d-9c6c-4dc0-a7e3-a95c9e26c3d6-metrics-certs\") pod \"network-metrics-daemon-9tpq5\" (UID: \"f208bc8d-9c6c-4dc0-a7e3-a95c9e26c3d6\") " pod="openshift-multus/network-metrics-daemon-9tpq5" Jul 21 14:18:59.248417 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:59.248343 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6ab945a0-5e72-4852-8a76-462020ef4af6-original-pull-secret\") pod \"global-pull-secret-syncer-4r4d6\" (UID: \"6ab945a0-5e72-4852-8a76-462020ef4af6\") " pod="kube-system/global-pull-secret-syncer-4r4d6" Jul 21 14:18:59.248704 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:59.248469 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrb74\" (UniqueName: \"kubernetes.io/projected/9d5c37aa-d496-4010-942a-92ead7dfa6b1-kube-api-access-wrb74\") pod \"network-check-target-fttn7\" (UID: \"9d5c37aa-d496-4010-942a-92ead7dfa6b1\") " pod="openshift-network-diagnostics/network-check-target-fttn7" Jul 21 14:18:59.252087 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:59.252044 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 21 14:18:59.252087 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:59.252046 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 21 14:18:59.261340 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:59.261300 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 21 14:18:59.261554 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:59.261314 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6ab945a0-5e72-4852-8a76-462020ef4af6-original-pull-secret\") pod \"global-pull-secret-syncer-4r4d6\" (UID: \"6ab945a0-5e72-4852-8a76-462020ef4af6\") " pod="kube-system/global-pull-secret-syncer-4r4d6" Jul 21 14:18:59.273193 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:59.273155 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrb74\" (UniqueName: \"kubernetes.io/projected/9d5c37aa-d496-4010-942a-92ead7dfa6b1-kube-api-access-wrb74\") pod \"network-check-target-fttn7\" (UID: \"9d5c37aa-d496-4010-942a-92ead7dfa6b1\") " pod="openshift-network-diagnostics/network-check-target-fttn7" Jul 21 14:18:59.345636 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:59.345598 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qcck5\"" Jul 21 14:18:59.353278 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:59.353231 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fttn7" Jul 21 14:18:59.353908 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:59.353886 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4r4d6" Jul 21 14:18:59.366905 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:59.366875 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2kbnq\"" Jul 21 14:18:59.374658 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:18:59.374624 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9tpq5" Jul 21 14:19:02.803569 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:02.803491 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d7fd86b9-cgfcm"] Jul 21 14:19:03.962744 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:03.962690 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4r4d6"] Jul 21 14:19:03.987229 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:03.987192 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fttn7"] Jul 21 14:19:03.994882 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:03.994807 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9tpq5"] Jul 21 14:19:04.068002 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:19:04.067956 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ab945a0_5e72_4852_8a76_462020ef4af6.slice/crio-5a370e378bbfafd9a2898ca058929faa30df51b968d8c6bd83ebdee44b3e0648 WatchSource:0}: Error finding container 5a370e378bbfafd9a2898ca058929faa30df51b968d8c6bd83ebdee44b3e0648: Status 404 returned error can't find the container with id 5a370e378bbfafd9a2898ca058929faa30df51b968d8c6bd83ebdee44b3e0648 Jul 21 14:19:04.068725 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:19:04.068539 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d5c37aa_d496_4010_942a_92ead7dfa6b1.slice/crio-a738b5519f39e80b5a1213450bcc069bb34e5235f8afebbac9c7d7121a32f497 WatchSource:0}: Error finding container a738b5519f39e80b5a1213450bcc069bb34e5235f8afebbac9c7d7121a32f497: Status 404 returned error can't find the container with id a738b5519f39e80b5a1213450bcc069bb34e5235f8afebbac9c7d7121a32f497 Jul 21 14:19:04.069684 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:19:04.069624 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf208bc8d_9c6c_4dc0_a7e3_a95c9e26c3d6.slice/crio-6fa8e5f4981a67591f75ecef60a69617f1a1a5bcc857250ca01c9f8811c8adb7 WatchSource:0}: Error finding container 6fa8e5f4981a67591f75ecef60a69617f1a1a5bcc857250ca01c9f8811c8adb7: Status 404 returned error can't find the container with id 6fa8e5f4981a67591f75ecef60a69617f1a1a5bcc857250ca01c9f8811c8adb7 Jul 21 14:19:04.907550 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:04.907358 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4r4d6" event={"ID":"6ab945a0-5e72-4852-8a76-462020ef4af6","Type":"ContainerStarted","Data":"5a370e378bbfafd9a2898ca058929faa30df51b968d8c6bd83ebdee44b3e0648"} Jul 21 14:19:04.914022 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:04.913862 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9tpq5" event={"ID":"f208bc8d-9c6c-4dc0-a7e3-a95c9e26c3d6","Type":"ContainerStarted","Data":"6fa8e5f4981a67591f75ecef60a69617f1a1a5bcc857250ca01c9f8811c8adb7"} Jul 21 14:19:04.919908 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:04.919194 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-tdgzg" event={"ID":"cbf75b07-d001-4306-b1c4-739f89f1ddf5","Type":"ContainerStarted","Data":"cc942eeeeefc1f2446d92d7bac3da18a55094c50e2f525d8f81d7a3ef2999659"} Jul 21 14:19:04.919908 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:04.919706 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-tdgzg" event={"ID":"cbf75b07-d001-4306-b1c4-739f89f1ddf5","Type":"ContainerStarted","Data":"7e81ffa9d5460efe6fd0abf4fc5caf9d4287831ab4fe2f10726f5dd9f07b10ae"} Jul 21 14:19:04.926695 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:04.926563 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-dwdzd" event={"ID":"7ab873ea-a45a-4aae-93ec-54ce3552389d","Type":"ContainerStarted","Data":"a25ed9eda55291e5ad6ab76c09b762ef398122249aeb8cf5b834bf4d61b5d556"} Jul 21 14:19:04.928452 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:04.928405 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-dwdzd" Jul 21 14:19:04.933840 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:04.933760 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fttn7" event={"ID":"9d5c37aa-d496-4010-942a-92ead7dfa6b1","Type":"ContainerStarted","Data":"a738b5519f39e80b5a1213450bcc069bb34e5235f8afebbac9c7d7121a32f497"} Jul 21 14:19:04.942001 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:04.941681 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-tdgzg" podStartSLOduration=5.842203555 podStartE2EDuration="17.941649857s" totalImagesPullingTime="12.099446302s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:18:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:19:04.940304748 +0000 UTC m=+71.958208335" watchObservedRunningTime="2026-07-21 14:19:04.941649857 +0000 UTC m=+71.959553431" Jul 21 14:19:04.943267 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:04.943189 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-dwdzd" Jul 21 14:19:04.943476 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:04.943273 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zrtj8" event={"ID":"6c7af6c4-9136-4fbe-a126-fb15ac1b568f","Type":"ContainerStarted","Data":"19d5625295dbac21a4f6daccd08a949fd7c4272ec7d2b9072fe63bd0d7d0893f"} Jul 21 14:19:04.969651 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:04.969301 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-dwdzd" podStartSLOduration=2.514401722 podStartE2EDuration="25.969261894s" totalImagesPullingTime="23.454860172s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:18:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:19:04.967176923 +0000 UTC m=+71.985080509" watchObservedRunningTime="2026-07-21 14:19:04.969261894 +0000 UTC m=+71.987165550" Jul 21 14:19:06.930657 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:06.930099 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-6pbqt"] Jul 21 14:19:06.956658 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:06.956338 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-6pbqt" Jul 21 14:19:06.962129 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:06.961247 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-6pbqt"] Jul 21 14:19:06.962129 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:06.962113 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-742gl\"" Jul 21 14:19:06.964056 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:06.963260 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 21 14:19:06.964056 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:06.963600 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 21 14:19:06.968279 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:06.967659 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9tpq5" event={"ID":"f208bc8d-9c6c-4dc0-a7e3-a95c9e26c3d6","Type":"ContainerStarted","Data":"76087f1f765e74acef990b6d3af72a42e714811b914fd40f73b10d03cb9f40df"} Jul 21 14:19:06.968279 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:06.967744 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9tpq5" event={"ID":"f208bc8d-9c6c-4dc0-a7e3-a95c9e26c3d6","Type":"ContainerStarted","Data":"74012cda55cdd068e2c316389b63ad092d51a0bbfd1fd590a494ebc5a09ae4db"} Jul 21 14:19:06.980728 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:06.980688 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-p26cs"] Jul 21 14:19:07.015821 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:07.015542 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-p26cs" Jul 21 14:19:07.024456 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:07.021705 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 21 14:19:07.024456 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:07.022225 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 21 14:19:07.024456 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:07.022497 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-nlq6z\"" Jul 21 14:19:07.024456 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:07.022768 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 21 14:19:07.060035 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:07.059964 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-9tpq5" podStartSLOduration=71.798920274 podStartE2EDuration="1m14.059938311s" totalImagesPullingTime="2.261018037s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:17:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:19:07.059480645 +0000 UTC m=+74.077384219" watchObservedRunningTime="2026-07-21 14:19:07.059938311 +0000 UTC m=+74.077841884" Jul 21 14:19:07.125669 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:07.125595 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3ae0a42a-7de4-4142-9326-059cf91b3a1e-sys\") pod \"node-exporter-p26cs\" (UID: \"3ae0a42a-7de4-4142-9326-059cf91b3a1e\") " pod="openshift-monitoring/node-exporter-p26cs" Jul 21 14:19:07.126074 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:07.125711 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/48b8c55c-66f2-45af-89fc-590ce1c54f44-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-6pbqt\" (UID: \"48b8c55c-66f2-45af-89fc-590ce1c54f44\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-6pbqt" Jul 21 14:19:07.126074 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:07.125758 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgbj8\" (UniqueName: \"kubernetes.io/projected/48b8c55c-66f2-45af-89fc-590ce1c54f44-kube-api-access-qgbj8\") pod \"openshift-state-metrics-79f6958cdf-6pbqt\" (UID: \"48b8c55c-66f2-45af-89fc-590ce1c54f44\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-6pbqt" Jul 21 14:19:07.126074 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:07.125817 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3ae0a42a-7de4-4142-9326-059cf91b3a1e-metrics-client-ca\") pod \"node-exporter-p26cs\" (UID: \"3ae0a42a-7de4-4142-9326-059cf91b3a1e\") " pod="openshift-monitoring/node-exporter-p26cs" Jul 21 14:19:07.126074 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:07.125860 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3ae0a42a-7de4-4142-9326-059cf91b3a1e-node-exporter-accelerators-collector-config\") pod \"node-exporter-p26cs\" (UID: \"3ae0a42a-7de4-4142-9326-059cf91b3a1e\") " pod="openshift-monitoring/node-exporter-p26cs" Jul 21 14:19:07.126074 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:07.125927 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3ae0a42a-7de4-4142-9326-059cf91b3a1e-root\") pod \"node-exporter-p26cs\" (UID: \"3ae0a42a-7de4-4142-9326-059cf91b3a1e\") " pod="openshift-monitoring/node-exporter-p26cs" Jul 21 14:19:07.126074 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:07.125976 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3ae0a42a-7de4-4142-9326-059cf91b3a1e-node-exporter-textfile\") pod \"node-exporter-p26cs\" (UID: \"3ae0a42a-7de4-4142-9326-059cf91b3a1e\") " pod="openshift-monitoring/node-exporter-p26cs" Jul 21 14:19:07.126074 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:07.126041 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/48b8c55c-66f2-45af-89fc-590ce1c54f44-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-6pbqt\" (UID: \"48b8c55c-66f2-45af-89fc-590ce1c54f44\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-6pbqt" Jul 21 14:19:07.126074 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:07.126074 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3ae0a42a-7de4-4142-9326-059cf91b3a1e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p26cs\" (UID: \"3ae0a42a-7de4-4142-9326-059cf91b3a1e\") " pod="openshift-monitoring/node-exporter-p26cs" Jul 21 14:19:07.126521 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:07.126115 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3ae0a42a-7de4-4142-9326-059cf91b3a1e-node-exporter-tls\") pod \"node-exporter-p26cs\" (UID: \"3ae0a42a-7de4-4142-9326-059cf91b3a1e\") " pod="openshift-monitoring/node-exporter-p26cs" Jul 21 14:19:07.126521 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:07.126172 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/48b8c55c-66f2-45af-89fc-590ce1c54f44-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-6pbqt\" (UID: \"48b8c55c-66f2-45af-89fc-590ce1c54f44\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-6pbqt" Jul 21 14:19:07.126521 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:07.126485 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3ae0a42a-7de4-4142-9326-059cf91b3a1e-node-exporter-wtmp\") pod \"node-exporter-p26cs\" (UID: \"3ae0a42a-7de4-4142-9326-059cf91b3a1e\") " pod="openshift-monitoring/node-exporter-p26cs" Jul 21 14:19:07.127649 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:07.127264 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcjw4\" (UniqueName: \"kubernetes.io/projected/3ae0a42a-7de4-4142-9326-059cf91b3a1e-kube-api-access-lcjw4\") pod \"node-exporter-p26cs\" (UID: \"3ae0a42a-7de4-4142-9326-059cf91b3a1e\") " pod="openshift-monitoring/node-exporter-p26cs" Jul 21 14:19:07.228377 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:07.228278 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3ae0a42a-7de4-4142-9326-059cf91b3a1e-node-exporter-accelerators-collector-config\") pod \"node-exporter-p26cs\" (UID: \"3ae0a42a-7de4-4142-9326-059cf91b3a1e\") " pod="openshift-monitoring/node-exporter-p26cs" Jul 21 14:19:07.228377 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:07.228336 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3ae0a42a-7de4-4142-9326-059cf91b3a1e-root\") pod \"node-exporter-p26cs\" (UID: \"3ae0a42a-7de4-4142-9326-059cf91b3a1e\") " pod="openshift-monitoring/node-exporter-p26cs" Jul 21 14:19:07.228377 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:07.228367 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3ae0a42a-7de4-4142-9326-059cf91b3a1e-node-exporter-textfile\") pod \"node-exporter-p26cs\" (UID: \"3ae0a42a-7de4-4142-9326-059cf91b3a1e\") " pod="openshift-monitoring/node-exporter-p26cs" Jul 21 14:19:07.229545 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:07.228405 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/48b8c55c-66f2-45af-89fc-590ce1c54f44-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-6pbqt\" (UID: \"48b8c55c-66f2-45af-89fc-590ce1c54f44\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-6pbqt" Jul 21 14:19:07.229545 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:07.228436 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3ae0a42a-7de4-4142-9326-059cf91b3a1e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p26cs\" (UID: \"3ae0a42a-7de4-4142-9326-059cf91b3a1e\") " pod="openshift-monitoring/node-exporter-p26cs" Jul 21 14:19:07.229545 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:07.228466 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3ae0a42a-7de4-4142-9326-059cf91b3a1e-node-exporter-tls\") pod \"node-exporter-p26cs\" (UID: \"3ae0a42a-7de4-4142-9326-059cf91b3a1e\") " pod="openshift-monitoring/node-exporter-p26cs" Jul 21 14:19:07.229545 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:07.228506 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/48b8c55c-66f2-45af-89fc-590ce1c54f44-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-6pbqt\" (UID: \"48b8c55c-66f2-45af-89fc-590ce1c54f44\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-6pbqt" Jul 21 14:19:07.229545 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:07.228541 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3ae0a42a-7de4-4142-9326-059cf91b3a1e-node-exporter-wtmp\") pod \"node-exporter-p26cs\" (UID: \"3ae0a42a-7de4-4142-9326-059cf91b3a1e\") " pod="openshift-monitoring/node-exporter-p26cs" Jul 21 14:19:07.229545 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:07.228579 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcjw4\" (UniqueName: \"kubernetes.io/projected/3ae0a42a-7de4-4142-9326-059cf91b3a1e-kube-api-access-lcjw4\") pod \"node-exporter-p26cs\" (UID: \"3ae0a42a-7de4-4142-9326-059cf91b3a1e\") " pod="openshift-monitoring/node-exporter-p26cs" Jul 21 14:19:07.229545 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:07.228610 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3ae0a42a-7de4-4142-9326-059cf91b3a1e-sys\") pod \"node-exporter-p26cs\" (UID: \"3ae0a42a-7de4-4142-9326-059cf91b3a1e\") " pod="openshift-monitoring/node-exporter-p26cs" Jul 21 14:19:07.229545 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:07.228645 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/48b8c55c-66f2-45af-89fc-590ce1c54f44-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-6pbqt\" (UID: \"48b8c55c-66f2-45af-89fc-590ce1c54f44\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-6pbqt" Jul 21 14:19:07.229545 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:07.228671 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgbj8\" (UniqueName: \"kubernetes.io/projected/48b8c55c-66f2-45af-89fc-590ce1c54f44-kube-api-access-qgbj8\") pod \"openshift-state-metrics-79f6958cdf-6pbqt\" (UID: \"48b8c55c-66f2-45af-89fc-590ce1c54f44\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-6pbqt" Jul 21 14:19:07.229545 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:07.228696 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3ae0a42a-7de4-4142-9326-059cf91b3a1e-metrics-client-ca\") pod \"node-exporter-p26cs\" (UID: \"3ae0a42a-7de4-4142-9326-059cf91b3a1e\") " pod="openshift-monitoring/node-exporter-p26cs" Jul 21 14:19:07.229545 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:07.229415 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3ae0a42a-7de4-4142-9326-059cf91b3a1e-metrics-client-ca\") pod \"node-exporter-p26cs\" (UID: \"3ae0a42a-7de4-4142-9326-059cf91b3a1e\") " pod="openshift-monitoring/node-exporter-p26cs" Jul 21 14:19:07.230151 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:07.229944 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3ae0a42a-7de4-4142-9326-059cf91b3a1e-node-exporter-accelerators-collector-config\") pod \"node-exporter-p26cs\" (UID: \"3ae0a42a-7de4-4142-9326-059cf91b3a1e\") " pod="openshift-monitoring/node-exporter-p26cs" Jul 21 14:19:07.230151 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:07.230012 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3ae0a42a-7de4-4142-9326-059cf91b3a1e-root\") pod \"node-exporter-p26cs\" (UID: \"3ae0a42a-7de4-4142-9326-059cf91b3a1e\") " pod="openshift-monitoring/node-exporter-p26cs" Jul 21 14:19:07.230281 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:07.230244 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3ae0a42a-7de4-4142-9326-059cf91b3a1e-node-exporter-textfile\") pod \"node-exporter-p26cs\" (UID: \"3ae0a42a-7de4-4142-9326-059cf91b3a1e\") " pod="openshift-monitoring/node-exporter-p26cs" Jul 21 14:19:07.231105 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:07.231066 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/48b8c55c-66f2-45af-89fc-590ce1c54f44-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-6pbqt\" (UID: \"48b8c55c-66f2-45af-89fc-590ce1c54f44\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-6pbqt" Jul 21 14:19:07.233110 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:07.232485 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3ae0a42a-7de4-4142-9326-059cf91b3a1e-node-exporter-wtmp\") pod \"node-exporter-p26cs\" (UID: \"3ae0a42a-7de4-4142-9326-059cf91b3a1e\") " pod="openshift-monitoring/node-exporter-p26cs" Jul 21 14:19:07.233110 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:19:07.232654 2576 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 21 14:19:07.233110 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:19:07.232762 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ae0a42a-7de4-4142-9326-059cf91b3a1e-node-exporter-tls podName:3ae0a42a-7de4-4142-9326-059cf91b3a1e nodeName:}" failed. No retries permitted until 2026-07-21 14:19:07.732727257 +0000 UTC m=+74.750630814 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/3ae0a42a-7de4-4142-9326-059cf91b3a1e-node-exporter-tls") pod "node-exporter-p26cs" (UID: "3ae0a42a-7de4-4142-9326-059cf91b3a1e") : secret "node-exporter-tls" not found Jul 21 14:19:07.233110 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:07.232848 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3ae0a42a-7de4-4142-9326-059cf91b3a1e-sys\") pod \"node-exporter-p26cs\" (UID: \"3ae0a42a-7de4-4142-9326-059cf91b3a1e\") " pod="openshift-monitoring/node-exporter-p26cs" Jul 21 14:19:07.240700 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:07.240511 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/48b8c55c-66f2-45af-89fc-590ce1c54f44-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-6pbqt\" (UID: \"48b8c55c-66f2-45af-89fc-590ce1c54f44\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-6pbqt" Jul 21 14:19:07.241396 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:07.241323 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3ae0a42a-7de4-4142-9326-059cf91b3a1e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p26cs\" (UID: \"3ae0a42a-7de4-4142-9326-059cf91b3a1e\") " pod="openshift-monitoring/node-exporter-p26cs" Jul 21 14:19:07.256264 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:07.250586 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/48b8c55c-66f2-45af-89fc-590ce1c54f44-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-6pbqt\" (UID: \"48b8c55c-66f2-45af-89fc-590ce1c54f44\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-6pbqt" Jul 21 14:19:07.261194 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:07.261067 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcjw4\" (UniqueName: \"kubernetes.io/projected/3ae0a42a-7de4-4142-9326-059cf91b3a1e-kube-api-access-lcjw4\") pod \"node-exporter-p26cs\" (UID: \"3ae0a42a-7de4-4142-9326-059cf91b3a1e\") " pod="openshift-monitoring/node-exporter-p26cs" Jul 21 14:19:07.273623 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:07.273464 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgbj8\" (UniqueName: \"kubernetes.io/projected/48b8c55c-66f2-45af-89fc-590ce1c54f44-kube-api-access-qgbj8\") pod \"openshift-state-metrics-79f6958cdf-6pbqt\" (UID: \"48b8c55c-66f2-45af-89fc-590ce1c54f44\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-6pbqt" Jul 21 14:19:07.274914 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:07.274856 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-6pbqt" Jul 21 14:19:07.539098 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:07.539024 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-6pbqt"] Jul 21 14:19:07.733911 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:07.733095 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3ae0a42a-7de4-4142-9326-059cf91b3a1e-node-exporter-tls\") pod \"node-exporter-p26cs\" (UID: \"3ae0a42a-7de4-4142-9326-059cf91b3a1e\") " pod="openshift-monitoring/node-exporter-p26cs" Jul 21 14:19:07.740076 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:07.740001 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3ae0a42a-7de4-4142-9326-059cf91b3a1e-node-exporter-tls\") pod \"node-exporter-p26cs\" (UID: \"3ae0a42a-7de4-4142-9326-059cf91b3a1e\") " pod="openshift-monitoring/node-exporter-p26cs" Jul 21 14:19:07.935066 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:07.934917 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-p26cs" Jul 21 14:19:09.604651 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:19:09.604597 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48b8c55c_66f2_45af_89fc_590ce1c54f44.slice/crio-bbe71045e2978f41d5512e760f376b9c81cbb20d8d8d7809aca8240c36a27796 WatchSource:0}: Error finding container bbe71045e2978f41d5512e760f376b9c81cbb20d8d8d7809aca8240c36a27796: Status 404 returned error can't find the container with id bbe71045e2978f41d5512e760f376b9c81cbb20d8d8d7809aca8240c36a27796 Jul 21 14:19:09.905264 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:09.905164 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-786f77dcf4-bw2qh"] Jul 21 14:19:09.937808 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:09.929744 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-786f77dcf4-bw2qh"] Jul 21 14:19:09.937808 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:09.929980 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-786f77dcf4-bw2qh" Jul 21 14:19:09.941672 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:09.939586 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-65lzp\"" Jul 21 14:19:09.941672 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:09.939939 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 21 14:19:09.941672 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:09.941216 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 21 14:19:09.941672 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:09.941425 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-521gld5ooeoq6\"" Jul 21 14:19:09.945365 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:09.942483 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 21 14:19:09.957750 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:09.957257 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b85723a-2710-4317-b453-4f2b63eb6478-metrics-client-ca\") pod \"thanos-querier-786f77dcf4-bw2qh\" (UID: \"6b85723a-2710-4317-b453-4f2b63eb6478\") " pod="openshift-monitoring/thanos-querier-786f77dcf4-bw2qh" Jul 21 14:19:09.957750 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:09.957315 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrmlb\" (UniqueName: \"kubernetes.io/projected/6b85723a-2710-4317-b453-4f2b63eb6478-kube-api-access-zrmlb\") pod \"thanos-querier-786f77dcf4-bw2qh\" (UID: \"6b85723a-2710-4317-b453-4f2b63eb6478\") " pod="openshift-monitoring/thanos-querier-786f77dcf4-bw2qh" Jul 21 14:19:09.957750 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:09.957357 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6b85723a-2710-4317-b453-4f2b63eb6478-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-786f77dcf4-bw2qh\" (UID: \"6b85723a-2710-4317-b453-4f2b63eb6478\") " pod="openshift-monitoring/thanos-querier-786f77dcf4-bw2qh" Jul 21 14:19:09.957750 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:09.957390 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6b85723a-2710-4317-b453-4f2b63eb6478-secret-grpc-tls\") pod \"thanos-querier-786f77dcf4-bw2qh\" (UID: \"6b85723a-2710-4317-b453-4f2b63eb6478\") " pod="openshift-monitoring/thanos-querier-786f77dcf4-bw2qh" Jul 21 14:19:09.957750 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:09.957428 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6b85723a-2710-4317-b453-4f2b63eb6478-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-786f77dcf4-bw2qh\" (UID: \"6b85723a-2710-4317-b453-4f2b63eb6478\") " pod="openshift-monitoring/thanos-querier-786f77dcf4-bw2qh" Jul 21 14:19:09.957750 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:09.957485 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6b85723a-2710-4317-b453-4f2b63eb6478-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-786f77dcf4-bw2qh\" (UID: \"6b85723a-2710-4317-b453-4f2b63eb6478\") " pod="openshift-monitoring/thanos-querier-786f77dcf4-bw2qh" Jul 21 14:19:09.957750 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:09.957523 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6b85723a-2710-4317-b453-4f2b63eb6478-secret-thanos-querier-tls\") pod \"thanos-querier-786f77dcf4-bw2qh\" (UID: \"6b85723a-2710-4317-b453-4f2b63eb6478\") " pod="openshift-monitoring/thanos-querier-786f77dcf4-bw2qh" Jul 21 14:19:09.957750 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:09.957567 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6b85723a-2710-4317-b453-4f2b63eb6478-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-786f77dcf4-bw2qh\" (UID: \"6b85723a-2710-4317-b453-4f2b63eb6478\") " pod="openshift-monitoring/thanos-querier-786f77dcf4-bw2qh" Jul 21 14:19:09.961909 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:09.959811 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 21 14:19:09.961909 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:09.960111 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 21 14:19:09.990240 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:09.990184 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-6pbqt" event={"ID":"48b8c55c-66f2-45af-89fc-590ce1c54f44","Type":"ContainerStarted","Data":"bbe71045e2978f41d5512e760f376b9c81cbb20d8d8d7809aca8240c36a27796"} Jul 21 14:19:10.058735 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:10.058373 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6b85723a-2710-4317-b453-4f2b63eb6478-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-786f77dcf4-bw2qh\" (UID: \"6b85723a-2710-4317-b453-4f2b63eb6478\") " pod="openshift-monitoring/thanos-querier-786f77dcf4-bw2qh" Jul 21 14:19:10.058735 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:10.058469 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6b85723a-2710-4317-b453-4f2b63eb6478-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-786f77dcf4-bw2qh\" (UID: \"6b85723a-2710-4317-b453-4f2b63eb6478\") " pod="openshift-monitoring/thanos-querier-786f77dcf4-bw2qh" Jul 21 14:19:10.058735 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:10.058520 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6b85723a-2710-4317-b453-4f2b63eb6478-secret-thanos-querier-tls\") pod \"thanos-querier-786f77dcf4-bw2qh\" (UID: \"6b85723a-2710-4317-b453-4f2b63eb6478\") " pod="openshift-monitoring/thanos-querier-786f77dcf4-bw2qh" Jul 21 14:19:10.058735 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:10.058574 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6b85723a-2710-4317-b453-4f2b63eb6478-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-786f77dcf4-bw2qh\" (UID: \"6b85723a-2710-4317-b453-4f2b63eb6478\") " pod="openshift-monitoring/thanos-querier-786f77dcf4-bw2qh" Jul 21 14:19:10.058735 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:10.058634 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b85723a-2710-4317-b453-4f2b63eb6478-metrics-client-ca\") pod \"thanos-querier-786f77dcf4-bw2qh\" (UID: \"6b85723a-2710-4317-b453-4f2b63eb6478\") " pod="openshift-monitoring/thanos-querier-786f77dcf4-bw2qh" Jul 21 14:19:10.059312 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:10.059109 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrmlb\" (UniqueName: \"kubernetes.io/projected/6b85723a-2710-4317-b453-4f2b63eb6478-kube-api-access-zrmlb\") pod \"thanos-querier-786f77dcf4-bw2qh\" (UID: \"6b85723a-2710-4317-b453-4f2b63eb6478\") " pod="openshift-monitoring/thanos-querier-786f77dcf4-bw2qh" Jul 21 14:19:10.059312 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:10.059183 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6b85723a-2710-4317-b453-4f2b63eb6478-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-786f77dcf4-bw2qh\" (UID: \"6b85723a-2710-4317-b453-4f2b63eb6478\") " pod="openshift-monitoring/thanos-querier-786f77dcf4-bw2qh" Jul 21 14:19:10.059312 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:10.059216 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6b85723a-2710-4317-b453-4f2b63eb6478-secret-grpc-tls\") pod \"thanos-querier-786f77dcf4-bw2qh\" (UID: \"6b85723a-2710-4317-b453-4f2b63eb6478\") " pod="openshift-monitoring/thanos-querier-786f77dcf4-bw2qh" Jul 21 14:19:10.060272 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:10.060237 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b85723a-2710-4317-b453-4f2b63eb6478-metrics-client-ca\") pod \"thanos-querier-786f77dcf4-bw2qh\" (UID: \"6b85723a-2710-4317-b453-4f2b63eb6478\") " pod="openshift-monitoring/thanos-querier-786f77dcf4-bw2qh" Jul 21 14:19:10.067255 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:10.063810 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6b85723a-2710-4317-b453-4f2b63eb6478-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-786f77dcf4-bw2qh\" (UID: \"6b85723a-2710-4317-b453-4f2b63eb6478\") " pod="openshift-monitoring/thanos-querier-786f77dcf4-bw2qh" Jul 21 14:19:10.067255 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:10.064211 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6b85723a-2710-4317-b453-4f2b63eb6478-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-786f77dcf4-bw2qh\" (UID: \"6b85723a-2710-4317-b453-4f2b63eb6478\") " pod="openshift-monitoring/thanos-querier-786f77dcf4-bw2qh" Jul 21 14:19:10.067255 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:10.065097 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6b85723a-2710-4317-b453-4f2b63eb6478-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-786f77dcf4-bw2qh\" (UID: \"6b85723a-2710-4317-b453-4f2b63eb6478\") " pod="openshift-monitoring/thanos-querier-786f77dcf4-bw2qh" Jul 21 14:19:10.067255 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:10.065099 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6b85723a-2710-4317-b453-4f2b63eb6478-secret-thanos-querier-tls\") pod \"thanos-querier-786f77dcf4-bw2qh\" (UID: \"6b85723a-2710-4317-b453-4f2b63eb6478\") " pod="openshift-monitoring/thanos-querier-786f77dcf4-bw2qh" Jul 21 14:19:10.068597 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:10.068517 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6b85723a-2710-4317-b453-4f2b63eb6478-secret-grpc-tls\") pod \"thanos-querier-786f77dcf4-bw2qh\" (UID: \"6b85723a-2710-4317-b453-4f2b63eb6478\") " pod="openshift-monitoring/thanos-querier-786f77dcf4-bw2qh" Jul 21 14:19:10.074111 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:10.074034 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrmlb\" (UniqueName: \"kubernetes.io/projected/6b85723a-2710-4317-b453-4f2b63eb6478-kube-api-access-zrmlb\") pod \"thanos-querier-786f77dcf4-bw2qh\" (UID: \"6b85723a-2710-4317-b453-4f2b63eb6478\") " pod="openshift-monitoring/thanos-querier-786f77dcf4-bw2qh" Jul 21 14:19:10.074904 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:10.074617 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6b85723a-2710-4317-b453-4f2b63eb6478-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-786f77dcf4-bw2qh\" (UID: \"6b85723a-2710-4317-b453-4f2b63eb6478\") " pod="openshift-monitoring/thanos-querier-786f77dcf4-bw2qh" Jul 21 14:19:10.260731 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:10.260441 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-786f77dcf4-bw2qh" Jul 21 14:19:11.568936 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:11.568837 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-s6nlh"] Jul 21 14:19:11.701562 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:11.701413 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-85d9859f9-jpb4r"] Jul 21 14:19:11.701872 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:11.701678 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-s6nlh" Jul 21 14:19:11.705072 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:11.705029 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 21 14:19:11.705381 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:11.705043 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-s6wr9\"" Jul 21 14:19:11.717686 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:11.717586 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-s6nlh"] Jul 21 14:19:11.717686 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:11.717638 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85d9859f9-jpb4r"] Jul 21 14:19:11.718093 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:11.717764 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85d9859f9-jpb4r" Jul 21 14:19:11.726557 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:11.726525 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 21 14:19:11.772590 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:11.772540 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f6462139-e4e3-45ba-91cf-f06429e6196a-console-oauth-config\") pod \"console-85d9859f9-jpb4r\" (UID: \"f6462139-e4e3-45ba-91cf-f06429e6196a\") " pod="openshift-console/console-85d9859f9-jpb4r" Jul 21 14:19:11.772590 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:11.772596 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f6462139-e4e3-45ba-91cf-f06429e6196a-console-config\") pod \"console-85d9859f9-jpb4r\" (UID: \"f6462139-e4e3-45ba-91cf-f06429e6196a\") " pod="openshift-console/console-85d9859f9-jpb4r" Jul 21 14:19:11.772889 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:11.772628 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f6462139-e4e3-45ba-91cf-f06429e6196a-oauth-serving-cert\") pod \"console-85d9859f9-jpb4r\" (UID: \"f6462139-e4e3-45ba-91cf-f06429e6196a\") " pod="openshift-console/console-85d9859f9-jpb4r" Jul 21 14:19:11.772889 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:11.772685 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9j96\" (UniqueName: \"kubernetes.io/projected/1edb1ef7-4c4c-40d8-a488-22bb5066e0b4-kube-api-access-k9j96\") pod \"monitoring-plugin-7b7b7bc8bf-s6nlh\" (UID: \"1edb1ef7-4c4c-40d8-a488-22bb5066e0b4\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-s6nlh" Jul 21 14:19:11.772889 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:11.772811 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f6462139-e4e3-45ba-91cf-f06429e6196a-console-serving-cert\") pod \"console-85d9859f9-jpb4r\" (UID: \"f6462139-e4e3-45ba-91cf-f06429e6196a\") " pod="openshift-console/console-85d9859f9-jpb4r" Jul 21 14:19:11.772889 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:11.772864 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f6462139-e4e3-45ba-91cf-f06429e6196a-service-ca\") pod \"console-85d9859f9-jpb4r\" (UID: \"f6462139-e4e3-45ba-91cf-f06429e6196a\") " pod="openshift-console/console-85d9859f9-jpb4r" Jul 21 14:19:11.773150 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:11.772935 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6462139-e4e3-45ba-91cf-f06429e6196a-trusted-ca-bundle\") pod \"console-85d9859f9-jpb4r\" (UID: \"f6462139-e4e3-45ba-91cf-f06429e6196a\") " pod="openshift-console/console-85d9859f9-jpb4r" Jul 21 14:19:11.773150 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:11.772989 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6m25\" (UniqueName: \"kubernetes.io/projected/f6462139-e4e3-45ba-91cf-f06429e6196a-kube-api-access-m6m25\") pod \"console-85d9859f9-jpb4r\" (UID: \"f6462139-e4e3-45ba-91cf-f06429e6196a\") " pod="openshift-console/console-85d9859f9-jpb4r" Jul 21 14:19:11.773150 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:11.773037 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1edb1ef7-4c4c-40d8-a488-22bb5066e0b4-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-s6nlh\" (UID: \"1edb1ef7-4c4c-40d8-a488-22bb5066e0b4\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-s6nlh" Jul 21 14:19:11.874092 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:11.873983 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1edb1ef7-4c4c-40d8-a488-22bb5066e0b4-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-s6nlh\" (UID: \"1edb1ef7-4c4c-40d8-a488-22bb5066e0b4\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-s6nlh" Jul 21 14:19:11.874092 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:11.874054 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f6462139-e4e3-45ba-91cf-f06429e6196a-console-oauth-config\") pod \"console-85d9859f9-jpb4r\" (UID: \"f6462139-e4e3-45ba-91cf-f06429e6196a\") " pod="openshift-console/console-85d9859f9-jpb4r" Jul 21 14:19:11.874092 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:11.874086 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f6462139-e4e3-45ba-91cf-f06429e6196a-console-config\") pod \"console-85d9859f9-jpb4r\" (UID: \"f6462139-e4e3-45ba-91cf-f06429e6196a\") " pod="openshift-console/console-85d9859f9-jpb4r" Jul 21 14:19:11.874442 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:11.874107 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f6462139-e4e3-45ba-91cf-f06429e6196a-oauth-serving-cert\") pod \"console-85d9859f9-jpb4r\" (UID: \"f6462139-e4e3-45ba-91cf-f06429e6196a\") " pod="openshift-console/console-85d9859f9-jpb4r" Jul 21 14:19:11.874442 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:11.874146 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9j96\" (UniqueName: \"kubernetes.io/projected/1edb1ef7-4c4c-40d8-a488-22bb5066e0b4-kube-api-access-k9j96\") pod \"monitoring-plugin-7b7b7bc8bf-s6nlh\" (UID: \"1edb1ef7-4c4c-40d8-a488-22bb5066e0b4\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-s6nlh" Jul 21 14:19:11.874442 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:11.874194 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f6462139-e4e3-45ba-91cf-f06429e6196a-console-serving-cert\") pod \"console-85d9859f9-jpb4r\" (UID: \"f6462139-e4e3-45ba-91cf-f06429e6196a\") " pod="openshift-console/console-85d9859f9-jpb4r" Jul 21 14:19:11.874442 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:11.874234 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f6462139-e4e3-45ba-91cf-f06429e6196a-service-ca\") pod \"console-85d9859f9-jpb4r\" (UID: \"f6462139-e4e3-45ba-91cf-f06429e6196a\") " pod="openshift-console/console-85d9859f9-jpb4r" Jul 21 14:19:11.874442 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:11.874290 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6462139-e4e3-45ba-91cf-f06429e6196a-trusted-ca-bundle\") pod \"console-85d9859f9-jpb4r\" (UID: \"f6462139-e4e3-45ba-91cf-f06429e6196a\") " pod="openshift-console/console-85d9859f9-jpb4r" Jul 21 14:19:11.874442 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:11.874314 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6m25\" (UniqueName: \"kubernetes.io/projected/f6462139-e4e3-45ba-91cf-f06429e6196a-kube-api-access-m6m25\") pod \"console-85d9859f9-jpb4r\" (UID: \"f6462139-e4e3-45ba-91cf-f06429e6196a\") " pod="openshift-console/console-85d9859f9-jpb4r" Jul 21 14:19:11.875274 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:11.875041 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f6462139-e4e3-45ba-91cf-f06429e6196a-oauth-serving-cert\") pod \"console-85d9859f9-jpb4r\" (UID: \"f6462139-e4e3-45ba-91cf-f06429e6196a\") " pod="openshift-console/console-85d9859f9-jpb4r" Jul 21 14:19:11.875274 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:11.875204 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f6462139-e4e3-45ba-91cf-f06429e6196a-console-config\") pod \"console-85d9859f9-jpb4r\" (UID: \"f6462139-e4e3-45ba-91cf-f06429e6196a\") " pod="openshift-console/console-85d9859f9-jpb4r" Jul 21 14:19:11.875524 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:11.875297 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f6462139-e4e3-45ba-91cf-f06429e6196a-service-ca\") pod \"console-85d9859f9-jpb4r\" (UID: \"f6462139-e4e3-45ba-91cf-f06429e6196a\") " pod="openshift-console/console-85d9859f9-jpb4r" Jul 21 14:19:11.875965 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:11.875863 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6462139-e4e3-45ba-91cf-f06429e6196a-trusted-ca-bundle\") pod \"console-85d9859f9-jpb4r\" (UID: \"f6462139-e4e3-45ba-91cf-f06429e6196a\") " pod="openshift-console/console-85d9859f9-jpb4r" Jul 21 14:19:11.877454 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:11.877429 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f6462139-e4e3-45ba-91cf-f06429e6196a-console-oauth-config\") pod \"console-85d9859f9-jpb4r\" (UID: \"f6462139-e4e3-45ba-91cf-f06429e6196a\") " pod="openshift-console/console-85d9859f9-jpb4r" Jul 21 14:19:11.877579 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:11.877545 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1edb1ef7-4c4c-40d8-a488-22bb5066e0b4-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-s6nlh\" (UID: \"1edb1ef7-4c4c-40d8-a488-22bb5066e0b4\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-s6nlh" Jul 21 14:19:11.878087 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:11.878055 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f6462139-e4e3-45ba-91cf-f06429e6196a-console-serving-cert\") pod \"console-85d9859f9-jpb4r\" (UID: \"f6462139-e4e3-45ba-91cf-f06429e6196a\") " pod="openshift-console/console-85d9859f9-jpb4r" Jul 21 14:19:11.886550 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:11.886511 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6m25\" (UniqueName: \"kubernetes.io/projected/f6462139-e4e3-45ba-91cf-f06429e6196a-kube-api-access-m6m25\") pod \"console-85d9859f9-jpb4r\" (UID: \"f6462139-e4e3-45ba-91cf-f06429e6196a\") " pod="openshift-console/console-85d9859f9-jpb4r" Jul 21 14:19:11.890612 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:11.890568 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9j96\" (UniqueName: \"kubernetes.io/projected/1edb1ef7-4c4c-40d8-a488-22bb5066e0b4-kube-api-access-k9j96\") pod \"monitoring-plugin-7b7b7bc8bf-s6nlh\" (UID: \"1edb1ef7-4c4c-40d8-a488-22bb5066e0b4\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-s6nlh" Jul 21 14:19:12.018146 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:12.018080 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-s6nlh" Jul 21 14:19:12.034973 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:12.034913 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85d9859f9-jpb4r" Jul 21 14:19:12.163126 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:12.163029 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-655f85b7c8-9p5hs"] Jul 21 14:19:12.178709 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:12.178585 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-655f85b7c8-9p5hs" Jul 21 14:19:12.182277 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:12.182238 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-4wlkl\"" Jul 21 14:19:12.182572 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:12.182513 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 21 14:19:12.182850 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:12.182812 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 21 14:19:12.184073 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:12.183095 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 21 14:19:12.184073 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:12.183304 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 21 14:19:12.184073 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:12.183471 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 21 14:19:12.188679 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:12.188637 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-655f85b7c8-9p5hs"] Jul 21 14:19:12.190722 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:12.189522 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 21 14:19:12.277065 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:12.277020 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0cc17485-2b48-4d45-a8be-f1048ef1e7f8-federate-client-tls\") pod \"telemeter-client-655f85b7c8-9p5hs\" (UID: \"0cc17485-2b48-4d45-a8be-f1048ef1e7f8\") " pod="openshift-monitoring/telemeter-client-655f85b7c8-9p5hs" Jul 21 14:19:12.277065 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:12.277067 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cc17485-2b48-4d45-a8be-f1048ef1e7f8-telemeter-trusted-ca-bundle\") pod \"telemeter-client-655f85b7c8-9p5hs\" (UID: \"0cc17485-2b48-4d45-a8be-f1048ef1e7f8\") " pod="openshift-monitoring/telemeter-client-655f85b7c8-9p5hs" Jul 21 14:19:12.277364 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:12.277094 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9s5c\" (UniqueName: \"kubernetes.io/projected/0cc17485-2b48-4d45-a8be-f1048ef1e7f8-kube-api-access-k9s5c\") pod \"telemeter-client-655f85b7c8-9p5hs\" (UID: \"0cc17485-2b48-4d45-a8be-f1048ef1e7f8\") " pod="openshift-monitoring/telemeter-client-655f85b7c8-9p5hs" Jul 21 14:19:12.277364 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:12.277119 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cc17485-2b48-4d45-a8be-f1048ef1e7f8-serving-certs-ca-bundle\") pod \"telemeter-client-655f85b7c8-9p5hs\" (UID: \"0cc17485-2b48-4d45-a8be-f1048ef1e7f8\") " pod="openshift-monitoring/telemeter-client-655f85b7c8-9p5hs" Jul 21 14:19:12.277364 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:12.277226 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0cc17485-2b48-4d45-a8be-f1048ef1e7f8-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-655f85b7c8-9p5hs\" (UID: \"0cc17485-2b48-4d45-a8be-f1048ef1e7f8\") " pod="openshift-monitoring/telemeter-client-655f85b7c8-9p5hs" Jul 21 14:19:12.277364 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:12.277352 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0cc17485-2b48-4d45-a8be-f1048ef1e7f8-metrics-client-ca\") pod \"telemeter-client-655f85b7c8-9p5hs\" (UID: \"0cc17485-2b48-4d45-a8be-f1048ef1e7f8\") " pod="openshift-monitoring/telemeter-client-655f85b7c8-9p5hs" Jul 21 14:19:12.277575 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:12.277396 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0cc17485-2b48-4d45-a8be-f1048ef1e7f8-secret-telemeter-client\") pod \"telemeter-client-655f85b7c8-9p5hs\" (UID: \"0cc17485-2b48-4d45-a8be-f1048ef1e7f8\") " pod="openshift-monitoring/telemeter-client-655f85b7c8-9p5hs" Jul 21 14:19:12.277575 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:12.277421 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0cc17485-2b48-4d45-a8be-f1048ef1e7f8-telemeter-client-tls\") pod \"telemeter-client-655f85b7c8-9p5hs\" (UID: \"0cc17485-2b48-4d45-a8be-f1048ef1e7f8\") " pod="openshift-monitoring/telemeter-client-655f85b7c8-9p5hs" Jul 21 14:19:12.379119 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:12.378124 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0cc17485-2b48-4d45-a8be-f1048ef1e7f8-metrics-client-ca\") pod \"telemeter-client-655f85b7c8-9p5hs\" (UID: \"0cc17485-2b48-4d45-a8be-f1048ef1e7f8\") " pod="openshift-monitoring/telemeter-client-655f85b7c8-9p5hs" Jul 21 14:19:12.379119 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:12.378211 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0cc17485-2b48-4d45-a8be-f1048ef1e7f8-secret-telemeter-client\") pod \"telemeter-client-655f85b7c8-9p5hs\" (UID: \"0cc17485-2b48-4d45-a8be-f1048ef1e7f8\") " pod="openshift-monitoring/telemeter-client-655f85b7c8-9p5hs" Jul 21 14:19:12.379119 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:12.378250 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0cc17485-2b48-4d45-a8be-f1048ef1e7f8-telemeter-client-tls\") pod \"telemeter-client-655f85b7c8-9p5hs\" (UID: \"0cc17485-2b48-4d45-a8be-f1048ef1e7f8\") " pod="openshift-monitoring/telemeter-client-655f85b7c8-9p5hs" Jul 21 14:19:12.379119 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:12.378299 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0cc17485-2b48-4d45-a8be-f1048ef1e7f8-federate-client-tls\") pod \"telemeter-client-655f85b7c8-9p5hs\" (UID: \"0cc17485-2b48-4d45-a8be-f1048ef1e7f8\") " pod="openshift-monitoring/telemeter-client-655f85b7c8-9p5hs" Jul 21 14:19:12.379119 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:12.378325 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cc17485-2b48-4d45-a8be-f1048ef1e7f8-telemeter-trusted-ca-bundle\") pod \"telemeter-client-655f85b7c8-9p5hs\" (UID: \"0cc17485-2b48-4d45-a8be-f1048ef1e7f8\") " pod="openshift-monitoring/telemeter-client-655f85b7c8-9p5hs" Jul 21 14:19:12.379119 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:12.378350 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9s5c\" (UniqueName: \"kubernetes.io/projected/0cc17485-2b48-4d45-a8be-f1048ef1e7f8-kube-api-access-k9s5c\") pod \"telemeter-client-655f85b7c8-9p5hs\" (UID: \"0cc17485-2b48-4d45-a8be-f1048ef1e7f8\") " pod="openshift-monitoring/telemeter-client-655f85b7c8-9p5hs" Jul 21 14:19:12.379119 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:12.378382 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cc17485-2b48-4d45-a8be-f1048ef1e7f8-serving-certs-ca-bundle\") pod \"telemeter-client-655f85b7c8-9p5hs\" (UID: \"0cc17485-2b48-4d45-a8be-f1048ef1e7f8\") " pod="openshift-monitoring/telemeter-client-655f85b7c8-9p5hs" Jul 21 14:19:12.379119 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:12.378428 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0cc17485-2b48-4d45-a8be-f1048ef1e7f8-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-655f85b7c8-9p5hs\" (UID: \"0cc17485-2b48-4d45-a8be-f1048ef1e7f8\") " pod="openshift-monitoring/telemeter-client-655f85b7c8-9p5hs" Jul 21 14:19:12.381872 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:12.381759 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cc17485-2b48-4d45-a8be-f1048ef1e7f8-telemeter-trusted-ca-bundle\") pod \"telemeter-client-655f85b7c8-9p5hs\" (UID: \"0cc17485-2b48-4d45-a8be-f1048ef1e7f8\") " pod="openshift-monitoring/telemeter-client-655f85b7c8-9p5hs" Jul 21 14:19:12.382512 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:12.382420 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0cc17485-2b48-4d45-a8be-f1048ef1e7f8-metrics-client-ca\") pod \"telemeter-client-655f85b7c8-9p5hs\" (UID: \"0cc17485-2b48-4d45-a8be-f1048ef1e7f8\") " pod="openshift-monitoring/telemeter-client-655f85b7c8-9p5hs" Jul 21 14:19:12.382512 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:12.382511 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cc17485-2b48-4d45-a8be-f1048ef1e7f8-serving-certs-ca-bundle\") pod \"telemeter-client-655f85b7c8-9p5hs\" (UID: \"0cc17485-2b48-4d45-a8be-f1048ef1e7f8\") " pod="openshift-monitoring/telemeter-client-655f85b7c8-9p5hs" Jul 21 14:19:12.383649 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:12.383593 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0cc17485-2b48-4d45-a8be-f1048ef1e7f8-federate-client-tls\") pod \"telemeter-client-655f85b7c8-9p5hs\" (UID: \"0cc17485-2b48-4d45-a8be-f1048ef1e7f8\") " pod="openshift-monitoring/telemeter-client-655f85b7c8-9p5hs" Jul 21 14:19:12.383969 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:12.383946 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0cc17485-2b48-4d45-a8be-f1048ef1e7f8-telemeter-client-tls\") pod \"telemeter-client-655f85b7c8-9p5hs\" (UID: \"0cc17485-2b48-4d45-a8be-f1048ef1e7f8\") " pod="openshift-monitoring/telemeter-client-655f85b7c8-9p5hs" Jul 21 14:19:12.385425 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:12.385377 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0cc17485-2b48-4d45-a8be-f1048ef1e7f8-secret-telemeter-client\") pod \"telemeter-client-655f85b7c8-9p5hs\" (UID: \"0cc17485-2b48-4d45-a8be-f1048ef1e7f8\") " pod="openshift-monitoring/telemeter-client-655f85b7c8-9p5hs" Jul 21 14:19:12.386326 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:12.386296 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0cc17485-2b48-4d45-a8be-f1048ef1e7f8-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-655f85b7c8-9p5hs\" (UID: \"0cc17485-2b48-4d45-a8be-f1048ef1e7f8\") " pod="openshift-monitoring/telemeter-client-655f85b7c8-9p5hs" Jul 21 14:19:12.391441 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:12.391397 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9s5c\" (UniqueName: \"kubernetes.io/projected/0cc17485-2b48-4d45-a8be-f1048ef1e7f8-kube-api-access-k9s5c\") pod \"telemeter-client-655f85b7c8-9p5hs\" (UID: \"0cc17485-2b48-4d45-a8be-f1048ef1e7f8\") " pod="openshift-monitoring/telemeter-client-655f85b7c8-9p5hs" Jul 21 14:19:12.497955 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:12.497890 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-655f85b7c8-9p5hs" Jul 21 14:19:14.483360 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:19:14.483268 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ae0a42a_7de4_4142_9326_059cf91b3a1e.slice/crio-2763466386e304d1c75d50a3895a4878b515f927ed51494c92058d810718f8a4 WatchSource:0}: Error finding container 2763466386e304d1c75d50a3895a4878b515f927ed51494c92058d810718f8a4: Status 404 returned error can't find the container with id 2763466386e304d1c75d50a3895a4878b515f927ed51494c92058d810718f8a4 Jul 21 14:19:14.796246 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:14.795862 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-786f77dcf4-bw2qh"] Jul 21 14:19:14.803818 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:14.803759 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-s6nlh"] Jul 21 14:19:14.828242 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:14.828203 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-655f85b7c8-9p5hs"] Jul 21 14:19:14.832213 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:19:14.832170 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cc17485_2b48_4d45_a8be_f1048ef1e7f8.slice/crio-93cc607c8731580a286ef3b942aabd617c4ebb293a7d1a7772e534a01258350e WatchSource:0}: Error finding container 93cc607c8731580a286ef3b942aabd617c4ebb293a7d1a7772e534a01258350e: Status 404 returned error can't find the container with id 93cc607c8731580a286ef3b942aabd617c4ebb293a7d1a7772e534a01258350e Jul 21 14:19:14.842902 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:14.842819 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85d9859f9-jpb4r"] Jul 21 14:19:15.018624 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:15.018568 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-s6nlh" event={"ID":"1edb1ef7-4c4c-40d8-a488-22bb5066e0b4","Type":"ContainerStarted","Data":"882b609d212a5548fcb37b0db7b00ea75dbba759c17c66ee0337d206e48f7590"} Jul 21 14:19:15.021183 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:15.021119 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-655f85b7c8-9p5hs" event={"ID":"0cc17485-2b48-4d45-a8be-f1048ef1e7f8","Type":"ContainerStarted","Data":"93cc607c8731580a286ef3b942aabd617c4ebb293a7d1a7772e534a01258350e"} Jul 21 14:19:15.023458 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:15.023331 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-786f77dcf4-bw2qh" event={"ID":"6b85723a-2710-4317-b453-4f2b63eb6478","Type":"ContainerStarted","Data":"976475baef3307ce905d99aea6c029aea0b55bb16cbe9a2e9a1ced1101e354af"} Jul 21 14:19:15.025256 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:15.025198 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p26cs" event={"ID":"3ae0a42a-7de4-4142-9326-059cf91b3a1e","Type":"ContainerStarted","Data":"2763466386e304d1c75d50a3895a4878b515f927ed51494c92058d810718f8a4"} Jul 21 14:19:15.027881 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:15.027820 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fttn7" event={"ID":"9d5c37aa-d496-4010-942a-92ead7dfa6b1","Type":"ContainerStarted","Data":"4d1f02660124f24a55a1cccc30832b22e8adccdfa65f2a0dd35429e1824a3843"} Jul 21 14:19:15.028161 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:15.027988 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-fttn7" Jul 21 14:19:15.034077 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:15.033941 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zrtj8" event={"ID":"6c7af6c4-9136-4fbe-a126-fb15ac1b568f","Type":"ContainerStarted","Data":"d68e1b56ede32797ae1826ce8e7f7ab7b628d6185d0aee98b60bed733e7de213"} Jul 21 14:19:15.037797 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:15.037278 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4r4d6" event={"ID":"6ab945a0-5e72-4852-8a76-462020ef4af6","Type":"ContainerStarted","Data":"78ff772d254624d44a43674a04995b9c5e43096f9d0c0a499223c51e8e0e010b"} Jul 21 14:19:15.044877 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:15.044809 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-6pbqt" event={"ID":"48b8c55c-66f2-45af-89fc-590ce1c54f44","Type":"ContainerStarted","Data":"711e1d09b7b5b921ec7fd855c588ee5ba14c7ec6b6a24a3cc27844a2555403a5"} Jul 21 14:19:15.045072 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:15.044920 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-6pbqt" event={"ID":"48b8c55c-66f2-45af-89fc-590ce1c54f44","Type":"ContainerStarted","Data":"2443965488a8af4684bf2952ade5052a6eb553f2180e2db37bd9d36e662ad5d8"} Jul 21 14:19:15.047979 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:15.047923 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85d9859f9-jpb4r" event={"ID":"f6462139-e4e3-45ba-91cf-f06429e6196a","Type":"ContainerStarted","Data":"bef0ff1f903135633f73401377f935d6eb01f04f8fff8e2afbc708d63debc2e6"} Jul 21 14:19:15.048233 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:15.048015 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85d9859f9-jpb4r" event={"ID":"f6462139-e4e3-45ba-91cf-f06429e6196a","Type":"ContainerStarted","Data":"503b8c58f3401e493c760ae8dedb7763760659f76c39f87aa4e906e3dd229ab2"} Jul 21 14:19:15.049687 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:15.049615 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-fttn7" podStartSLOduration=70.64072901 podStartE2EDuration="1m21.04959317s" totalImagesPullingTime="10.40886416s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:17:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:19:15.048006106 +0000 UTC m=+82.065909694" watchObservedRunningTime="2026-07-21 14:19:15.04959317 +0000 UTC m=+82.067496744" Jul 21 14:19:15.066148 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:15.066086 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-4r4d6" podStartSLOduration=70.663468644 podStartE2EDuration="1m21.066061662s" totalImagesPullingTime="10.402593018s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 14:17:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:19:15.065695707 +0000 UTC m=+82.083599303" watchObservedRunningTime="2026-07-21 14:19:15.066061662 +0000 UTC m=+82.083965237" Jul 21 14:19:15.089739 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:15.089640 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-zrtj8" podStartSLOduration=5.651605632 podStartE2EDuration="36.089605147s" totalImagesPullingTime="30.437999515s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 14:18:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:19:15.088212854 +0000 UTC m=+82.106116430" watchObservedRunningTime="2026-07-21 14:19:15.089605147 +0000 UTC m=+82.107508720" Jul 21 14:19:16.060162 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:16.060080 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p26cs" event={"ID":"3ae0a42a-7de4-4142-9326-059cf91b3a1e","Type":"ContainerStarted","Data":"838e18171f34268aca54f9eb6769d56c013aa7375432493cfa264e6a8c690382"} Jul 21 14:19:16.086103 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:16.086008 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-85d9859f9-jpb4r" podStartSLOduration=5.085984621 podStartE2EDuration="5.085984621s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:19:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:19:15.112185049 +0000 UTC m=+82.130088623" watchObservedRunningTime="2026-07-21 14:19:16.085984621 +0000 UTC m=+83.103888197" Jul 21 14:19:17.065052 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:17.065004 2576 generic.go:356] "Generic (PLEG): container finished" podID="3ae0a42a-7de4-4142-9326-059cf91b3a1e" containerID="838e18171f34268aca54f9eb6769d56c013aa7375432493cfa264e6a8c690382" exitCode=0 Jul 21 14:19:17.065620 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:17.065088 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p26cs" event={"ID":"3ae0a42a-7de4-4142-9326-059cf91b3a1e","Type":"ContainerDied","Data":"838e18171f34268aca54f9eb6769d56c013aa7375432493cfa264e6a8c690382"} Jul 21 14:19:19.081035 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:19.080974 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-s6nlh" event={"ID":"1edb1ef7-4c4c-40d8-a488-22bb5066e0b4","Type":"ContainerStarted","Data":"741ac071bc88cc785345e8f34fa374b9d0e695646bb972cdd75278f9be0c2990"} Jul 21 14:19:19.081551 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:19.081105 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-s6nlh" Jul 21 14:19:19.083525 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:19.083484 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-786f77dcf4-bw2qh" event={"ID":"6b85723a-2710-4317-b453-4f2b63eb6478","Type":"ContainerStarted","Data":"215167cd2de928d655ac93f0de6cc49ab82b0260b53490aae4ee4698b767af15"} Jul 21 14:19:19.083686 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:19.083570 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-786f77dcf4-bw2qh" event={"ID":"6b85723a-2710-4317-b453-4f2b63eb6478","Type":"ContainerStarted","Data":"5d54b4a91cddca1342b292ae3569e5198b38143ed6cc4fd6e2ac16e484c02fd3"} Jul 21 14:19:19.083686 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:19.083603 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-786f77dcf4-bw2qh" event={"ID":"6b85723a-2710-4317-b453-4f2b63eb6478","Type":"ContainerStarted","Data":"268b97ae733764b07c75d138e59fee17aaf4195a7634eae7d265e0911e0d0734"} Jul 21 14:19:19.085724 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:19.085687 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p26cs" event={"ID":"3ae0a42a-7de4-4142-9326-059cf91b3a1e","Type":"ContainerStarted","Data":"6b970a145425c8d6fd8f32fcf608af672d94ae314adca675eca5ae69f506fa9f"} Jul 21 14:19:19.085880 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:19.085736 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p26cs" event={"ID":"3ae0a42a-7de4-4142-9326-059cf91b3a1e","Type":"ContainerStarted","Data":"79b139787a1aed980af89cfdcff49f6143a9a8c82a18645101b3feffa893f387"} Jul 21 14:19:19.087071 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:19.087043 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-s6nlh" Jul 21 14:19:19.115982 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:19.115916 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-s6nlh" podStartSLOduration=4.812785751 podStartE2EDuration="8.115891125s" totalImagesPullingTime="3.303105374s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:19:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:19:19.115018988 +0000 UTC m=+86.132922553" watchObservedRunningTime="2026-07-21 14:19:19.115891125 +0000 UTC m=+86.133794700" Jul 21 14:19:19.139416 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:19.139347 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-p26cs" podStartSLOduration=11.658838767 podStartE2EDuration="13.139324858s" totalImagesPullingTime="1.358994629s" totalInitContainerRuntime="121.491462ms" isStatefulPod=true podCreationTimestamp="2026-07-21 14:19:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:19:19.138221127 +0000 UTC m=+86.156124729" watchObservedRunningTime="2026-07-21 14:19:19.139324858 +0000 UTC m=+86.157228423" Jul 21 14:19:20.092991 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:20.092943 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-6pbqt" event={"ID":"48b8c55c-66f2-45af-89fc-590ce1c54f44","Type":"ContainerStarted","Data":"9ee8bc439aa5b8460c0ae2c6585bfa1a30909944f7745226a0f3882888edebdb"} Jul 21 14:19:20.095999 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:20.095955 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-786f77dcf4-bw2qh" event={"ID":"6b85723a-2710-4317-b453-4f2b63eb6478","Type":"ContainerStarted","Data":"0f52e439ee1b0b5ce331843213e3c89beadb1cfa160c6b6b2274b9d8a34f8818"} Jul 21 14:19:20.130639 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:20.130542 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-6pbqt" podStartSLOduration=9.704180123 podStartE2EDuration="14.1305168s" totalImagesPullingTime="4.426336677s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:19:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:19:20.129247311 +0000 UTC m=+87.147150896" watchObservedRunningTime="2026-07-21 14:19:20.1305168 +0000 UTC m=+87.148420455" Jul 21 14:19:21.108344 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:21.108295 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-786f77dcf4-bw2qh" event={"ID":"6b85723a-2710-4317-b453-4f2b63eb6478","Type":"ContainerStarted","Data":"92ddfe3298d22f5eca51783996fdc9e3a1a5a9b6e58dd2b8edd10ff5ac0167c5"} Jul 21 14:19:21.108998 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:21.108398 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-786f77dcf4-bw2qh" event={"ID":"6b85723a-2710-4317-b453-4f2b63eb6478","Type":"ContainerStarted","Data":"b4aca2c33ecc5b04bda28081b7807a2b443052196ebc72276fd9edf27d72a10a"} Jul 21 14:19:21.137107 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:21.137020 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-786f77dcf4-bw2qh" podStartSLOduration=7.483299941 podStartE2EDuration="12.136992876s" totalImagesPullingTime="4.653692935s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:19:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:19:21.134590506 +0000 UTC m=+88.152494082" watchObservedRunningTime="2026-07-21 14:19:21.136992876 +0000 UTC m=+88.154896449" Jul 21 14:19:22.036062 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:22.035997 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-85d9859f9-jpb4r" Jul 21 14:19:22.036323 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:22.036091 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-85d9859f9-jpb4r" Jul 21 14:19:22.043413 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:22.043374 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-85d9859f9-jpb4r" Jul 21 14:19:22.114601 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:22.114556 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-786f77dcf4-bw2qh" Jul 21 14:19:22.120079 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:22.120046 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-85d9859f9-jpb4r" Jul 21 14:19:23.120103 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:23.120042 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-655f85b7c8-9p5hs" event={"ID":"0cc17485-2b48-4d45-a8be-f1048ef1e7f8","Type":"ContainerStarted","Data":"5388f4e23b0f0f80c8266c31c30f8c2e857e6ad6ebc411c1136e7f890952265f"} Jul 21 14:19:23.127109 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:23.127055 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-786f77dcf4-bw2qh" Jul 21 14:19:27.830806 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:27.830709 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7d7fd86b9-cgfcm" podUID="b77c139b-0a19-449b-91ee-72bb56be84ff" containerName="console" containerID="cri-o://772acdbf48fae081e1f831313cd2069df0e52bf81bb32a4c3b3b818ac256eca9" gracePeriod=15 Jul 21 14:19:28.147605 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:28.147555 2576 generic.go:356] "Generic (PLEG): container finished" podID="b77c139b-0a19-449b-91ee-72bb56be84ff" containerID="772acdbf48fae081e1f831313cd2069df0e52bf81bb32a4c3b3b818ac256eca9" exitCode=0 Jul 21 14:19:28.147888 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:28.147626 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d7fd86b9-cgfcm" event={"ID":"b77c139b-0a19-449b-91ee-72bb56be84ff","Type":"ContainerDied","Data":"772acdbf48fae081e1f831313cd2069df0e52bf81bb32a4c3b3b818ac256eca9"} Jul 21 14:19:28.147888 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:28.147723 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d7fd86b9-cgfcm" event={"ID":"b77c139b-0a19-449b-91ee-72bb56be84ff","Type":"ContainerDied","Data":"0d3e226a8151dc1c0f5e5e9eebd069be1fd024e45294649e9e333e415db213ae"} Jul 21 14:19:28.147888 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:28.147739 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0d3e226a8151dc1c0f5e5e9eebd069be1fd024e45294649e9e333e415db213ae" Jul 21 14:19:28.150526 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:28.150479 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-655f85b7c8-9p5hs" event={"ID":"0cc17485-2b48-4d45-a8be-f1048ef1e7f8","Type":"ContainerStarted","Data":"865c7a08e6efe902afab5b58a0f9dbb943378e2005e0b714e3c6befb11a91b0f"} Jul 21 14:19:28.150756 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:28.150562 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-655f85b7c8-9p5hs" event={"ID":"0cc17485-2b48-4d45-a8be-f1048ef1e7f8","Type":"ContainerStarted","Data":"047fa465514567d661ddf1e7cda580dda6680dded083fb97813d9334b884c973"} Jul 21 14:19:28.152286 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:28.152256 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d7fd86b9-cgfcm" Jul 21 14:19:28.179040 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:28.178952 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-655f85b7c8-9p5hs" podStartSLOduration=3.372556993 podStartE2EDuration="16.178925718s" totalImagesPullingTime="12.806368725s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:19:12 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:19:28.177066287 +0000 UTC m=+95.194969864" watchObservedRunningTime="2026-07-21 14:19:28.178925718 +0000 UTC m=+95.196829291" Jul 21 14:19:28.250288 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:28.250238 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b77c139b-0a19-449b-91ee-72bb56be84ff-console-oauth-config\") pod \"b77c139b-0a19-449b-91ee-72bb56be84ff\" (UID: \"b77c139b-0a19-449b-91ee-72bb56be84ff\") " Jul 21 14:19:28.250559 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:28.250323 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-879g4\" (UniqueName: \"kubernetes.io/projected/b77c139b-0a19-449b-91ee-72bb56be84ff-kube-api-access-879g4\") pod \"b77c139b-0a19-449b-91ee-72bb56be84ff\" (UID: \"b77c139b-0a19-449b-91ee-72bb56be84ff\") " Jul 21 14:19:28.250559 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:28.250345 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b77c139b-0a19-449b-91ee-72bb56be84ff-console-serving-cert\") pod \"b77c139b-0a19-449b-91ee-72bb56be84ff\" (UID: \"b77c139b-0a19-449b-91ee-72bb56be84ff\") " Jul 21 14:19:28.250559 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:28.250365 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b77c139b-0a19-449b-91ee-72bb56be84ff-service-ca\") pod \"b77c139b-0a19-449b-91ee-72bb56be84ff\" (UID: \"b77c139b-0a19-449b-91ee-72bb56be84ff\") " Jul 21 14:19:28.250559 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:28.250389 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b77c139b-0a19-449b-91ee-72bb56be84ff-console-config\") pod \"b77c139b-0a19-449b-91ee-72bb56be84ff\" (UID: \"b77c139b-0a19-449b-91ee-72bb56be84ff\") " Jul 21 14:19:28.250559 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:28.250433 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b77c139b-0a19-449b-91ee-72bb56be84ff-oauth-serving-cert\") pod \"b77c139b-0a19-449b-91ee-72bb56be84ff\" (UID: \"b77c139b-0a19-449b-91ee-72bb56be84ff\") " Jul 21 14:19:28.251013 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:28.250969 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b77c139b-0a19-449b-91ee-72bb56be84ff-service-ca" (OuterVolumeSpecName: "service-ca") pod "b77c139b-0a19-449b-91ee-72bb56be84ff" (UID: "b77c139b-0a19-449b-91ee-72bb56be84ff"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 14:19:28.251013 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:28.250974 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b77c139b-0a19-449b-91ee-72bb56be84ff-console-config" (OuterVolumeSpecName: "console-config") pod "b77c139b-0a19-449b-91ee-72bb56be84ff" (UID: "b77c139b-0a19-449b-91ee-72bb56be84ff"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 14:19:28.251153 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:28.251035 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b77c139b-0a19-449b-91ee-72bb56be84ff-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b77c139b-0a19-449b-91ee-72bb56be84ff" (UID: "b77c139b-0a19-449b-91ee-72bb56be84ff"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 14:19:28.251805 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:28.251583 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b77c139b-0a19-449b-91ee-72bb56be84ff-service-ca\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:19:28.251805 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:28.251612 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b77c139b-0a19-449b-91ee-72bb56be84ff-console-config\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:19:28.251805 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:28.251628 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b77c139b-0a19-449b-91ee-72bb56be84ff-oauth-serving-cert\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:19:28.253561 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:28.253533 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b77c139b-0a19-449b-91ee-72bb56be84ff-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b77c139b-0a19-449b-91ee-72bb56be84ff" (UID: "b77c139b-0a19-449b-91ee-72bb56be84ff"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 14:19:28.253661 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:28.253540 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b77c139b-0a19-449b-91ee-72bb56be84ff-kube-api-access-879g4" (OuterVolumeSpecName: "kube-api-access-879g4") pod "b77c139b-0a19-449b-91ee-72bb56be84ff" (UID: "b77c139b-0a19-449b-91ee-72bb56be84ff"). InnerVolumeSpecName "kube-api-access-879g4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 14:19:28.253661 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:28.253597 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b77c139b-0a19-449b-91ee-72bb56be84ff-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b77c139b-0a19-449b-91ee-72bb56be84ff" (UID: "b77c139b-0a19-449b-91ee-72bb56be84ff"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 14:19:28.353181 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:28.353065 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-879g4\" (UniqueName: \"kubernetes.io/projected/b77c139b-0a19-449b-91ee-72bb56be84ff-kube-api-access-879g4\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:19:28.353181 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:28.353105 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b77c139b-0a19-449b-91ee-72bb56be84ff-console-serving-cert\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:19:28.353181 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:28.353115 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b77c139b-0a19-449b-91ee-72bb56be84ff-console-oauth-config\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:19:28.921113 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:28.921073 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-57874bc659-zcbrz"] Jul 21 14:19:28.921520 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:28.921386 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b77c139b-0a19-449b-91ee-72bb56be84ff" containerName="console" Jul 21 14:19:28.921520 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:28.921398 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b77c139b-0a19-449b-91ee-72bb56be84ff" containerName="console" Jul 21 14:19:28.921520 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:28.921455 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b77c139b-0a19-449b-91ee-72bb56be84ff" containerName="console" Jul 21 14:19:28.954877 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:28.954774 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57874bc659-zcbrz"] Jul 21 14:19:28.955115 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:28.954926 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57874bc659-zcbrz" Jul 21 14:19:29.059935 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:29.059887 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b345cd05-5005-4b84-9f1b-2af62b53b108-console-serving-cert\") pod \"console-57874bc659-zcbrz\" (UID: \"b345cd05-5005-4b84-9f1b-2af62b53b108\") " pod="openshift-console/console-57874bc659-zcbrz" Jul 21 14:19:29.059935 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:29.059929 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkvsv\" (UniqueName: \"kubernetes.io/projected/b345cd05-5005-4b84-9f1b-2af62b53b108-kube-api-access-kkvsv\") pod \"console-57874bc659-zcbrz\" (UID: \"b345cd05-5005-4b84-9f1b-2af62b53b108\") " pod="openshift-console/console-57874bc659-zcbrz" Jul 21 14:19:29.060163 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:29.059964 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b345cd05-5005-4b84-9f1b-2af62b53b108-oauth-serving-cert\") pod \"console-57874bc659-zcbrz\" (UID: \"b345cd05-5005-4b84-9f1b-2af62b53b108\") " pod="openshift-console/console-57874bc659-zcbrz" Jul 21 14:19:29.060163 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:29.060004 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b345cd05-5005-4b84-9f1b-2af62b53b108-service-ca\") pod \"console-57874bc659-zcbrz\" (UID: \"b345cd05-5005-4b84-9f1b-2af62b53b108\") " pod="openshift-console/console-57874bc659-zcbrz" Jul 21 14:19:29.060163 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:29.060028 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b345cd05-5005-4b84-9f1b-2af62b53b108-console-oauth-config\") pod \"console-57874bc659-zcbrz\" (UID: \"b345cd05-5005-4b84-9f1b-2af62b53b108\") " pod="openshift-console/console-57874bc659-zcbrz" Jul 21 14:19:29.060163 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:29.060051 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b345cd05-5005-4b84-9f1b-2af62b53b108-console-config\") pod \"console-57874bc659-zcbrz\" (UID: \"b345cd05-5005-4b84-9f1b-2af62b53b108\") " pod="openshift-console/console-57874bc659-zcbrz" Jul 21 14:19:29.060163 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:29.060071 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b345cd05-5005-4b84-9f1b-2af62b53b108-trusted-ca-bundle\") pod \"console-57874bc659-zcbrz\" (UID: \"b345cd05-5005-4b84-9f1b-2af62b53b108\") " pod="openshift-console/console-57874bc659-zcbrz" Jul 21 14:19:29.157227 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:29.156116 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d7fd86b9-cgfcm" Jul 21 14:19:29.160455 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:29.160422 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b345cd05-5005-4b84-9f1b-2af62b53b108-console-serving-cert\") pod \"console-57874bc659-zcbrz\" (UID: \"b345cd05-5005-4b84-9f1b-2af62b53b108\") " pod="openshift-console/console-57874bc659-zcbrz" Jul 21 14:19:29.160455 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:29.160458 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkvsv\" (UniqueName: \"kubernetes.io/projected/b345cd05-5005-4b84-9f1b-2af62b53b108-kube-api-access-kkvsv\") pod \"console-57874bc659-zcbrz\" (UID: \"b345cd05-5005-4b84-9f1b-2af62b53b108\") " pod="openshift-console/console-57874bc659-zcbrz" Jul 21 14:19:29.160738 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:29.160604 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b345cd05-5005-4b84-9f1b-2af62b53b108-oauth-serving-cert\") pod \"console-57874bc659-zcbrz\" (UID: \"b345cd05-5005-4b84-9f1b-2af62b53b108\") " pod="openshift-console/console-57874bc659-zcbrz" Jul 21 14:19:29.160738 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:29.160658 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b345cd05-5005-4b84-9f1b-2af62b53b108-service-ca\") pod \"console-57874bc659-zcbrz\" (UID: \"b345cd05-5005-4b84-9f1b-2af62b53b108\") " pod="openshift-console/console-57874bc659-zcbrz" Jul 21 14:19:29.160738 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:29.160696 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b345cd05-5005-4b84-9f1b-2af62b53b108-console-oauth-config\") pod \"console-57874bc659-zcbrz\" (UID: \"b345cd05-5005-4b84-9f1b-2af62b53b108\") " pod="openshift-console/console-57874bc659-zcbrz" Jul 21 14:19:29.160738 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:29.160734 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b345cd05-5005-4b84-9f1b-2af62b53b108-console-config\") pod \"console-57874bc659-zcbrz\" (UID: \"b345cd05-5005-4b84-9f1b-2af62b53b108\") " pod="openshift-console/console-57874bc659-zcbrz" Jul 21 14:19:29.161077 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:29.160767 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b345cd05-5005-4b84-9f1b-2af62b53b108-trusted-ca-bundle\") pod \"console-57874bc659-zcbrz\" (UID: \"b345cd05-5005-4b84-9f1b-2af62b53b108\") " pod="openshift-console/console-57874bc659-zcbrz" Jul 21 14:19:29.161889 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:29.161439 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b345cd05-5005-4b84-9f1b-2af62b53b108-oauth-serving-cert\") pod \"console-57874bc659-zcbrz\" (UID: \"b345cd05-5005-4b84-9f1b-2af62b53b108\") " pod="openshift-console/console-57874bc659-zcbrz" Jul 21 14:19:29.161889 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:29.161826 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b345cd05-5005-4b84-9f1b-2af62b53b108-service-ca\") pod \"console-57874bc659-zcbrz\" (UID: \"b345cd05-5005-4b84-9f1b-2af62b53b108\") " pod="openshift-console/console-57874bc659-zcbrz" Jul 21 14:19:29.162083 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:29.161891 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b345cd05-5005-4b84-9f1b-2af62b53b108-console-config\") pod \"console-57874bc659-zcbrz\" (UID: \"b345cd05-5005-4b84-9f1b-2af62b53b108\") " pod="openshift-console/console-57874bc659-zcbrz" Jul 21 14:19:29.162083 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:29.161893 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b345cd05-5005-4b84-9f1b-2af62b53b108-trusted-ca-bundle\") pod \"console-57874bc659-zcbrz\" (UID: \"b345cd05-5005-4b84-9f1b-2af62b53b108\") " pod="openshift-console/console-57874bc659-zcbrz" Jul 21 14:19:29.165134 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:29.164168 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b345cd05-5005-4b84-9f1b-2af62b53b108-console-oauth-config\") pod \"console-57874bc659-zcbrz\" (UID: \"b345cd05-5005-4b84-9f1b-2af62b53b108\") " pod="openshift-console/console-57874bc659-zcbrz" Jul 21 14:19:29.165134 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:29.164675 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b345cd05-5005-4b84-9f1b-2af62b53b108-console-serving-cert\") pod \"console-57874bc659-zcbrz\" (UID: \"b345cd05-5005-4b84-9f1b-2af62b53b108\") " pod="openshift-console/console-57874bc659-zcbrz" Jul 21 14:19:29.175307 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:29.175274 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkvsv\" (UniqueName: \"kubernetes.io/projected/b345cd05-5005-4b84-9f1b-2af62b53b108-kube-api-access-kkvsv\") pod \"console-57874bc659-zcbrz\" (UID: \"b345cd05-5005-4b84-9f1b-2af62b53b108\") " pod="openshift-console/console-57874bc659-zcbrz" Jul 21 14:19:29.201301 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:29.201260 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d7fd86b9-cgfcm"] Jul 21 14:19:29.207833 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:29.207799 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7d7fd86b9-cgfcm"] Jul 21 14:19:29.267049 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:29.267000 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57874bc659-zcbrz" Jul 21 14:19:29.471834 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:29.471654 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57874bc659-zcbrz"] Jul 21 14:19:29.475587 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:19:29.475539 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb345cd05_5005_4b84_9f1b_2af62b53b108.slice/crio-a942bf9229b64c217b469440c7ad39203177fef7e5e56b1cd3ba213af38fe4fc WatchSource:0}: Error finding container a942bf9229b64c217b469440c7ad39203177fef7e5e56b1cd3ba213af38fe4fc: Status 404 returned error can't find the container with id a942bf9229b64c217b469440c7ad39203177fef7e5e56b1cd3ba213af38fe4fc Jul 21 14:19:29.525915 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:29.525881 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b77c139b-0a19-449b-91ee-72bb56be84ff" path="/var/lib/kubelet/pods/b77c139b-0a19-449b-91ee-72bb56be84ff/volumes" Jul 21 14:19:30.161505 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:30.161469 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57874bc659-zcbrz" event={"ID":"b345cd05-5005-4b84-9f1b-2af62b53b108","Type":"ContainerStarted","Data":"bbc0e3a58ec9a77ac0a546309a171cb5b399a714ea4cfc4d9ce5876e0ad941c9"} Jul 21 14:19:30.161952 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:30.161526 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57874bc659-zcbrz" event={"ID":"b345cd05-5005-4b84-9f1b-2af62b53b108","Type":"ContainerStarted","Data":"a942bf9229b64c217b469440c7ad39203177fef7e5e56b1cd3ba213af38fe4fc"} Jul 21 14:19:30.184971 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:30.184924 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-57874bc659-zcbrz" podStartSLOduration=2.184907718 podStartE2EDuration="2.184907718s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:19:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:19:30.184605024 +0000 UTC m=+97.202508598" watchObservedRunningTime="2026-07-21 14:19:30.184907718 +0000 UTC m=+97.202811291" Jul 21 14:19:39.268106 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:39.268071 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-57874bc659-zcbrz" Jul 21 14:19:39.268597 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:39.268236 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-57874bc659-zcbrz" Jul 21 14:19:39.272839 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:39.272811 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-57874bc659-zcbrz" Jul 21 14:19:40.209601 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:40.209573 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-57874bc659-zcbrz" Jul 21 14:19:40.261664 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:40.261625 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85d9859f9-jpb4r"] Jul 21 14:19:46.063203 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:19:46.063170 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-fttn7" Jul 21 14:20:05.284281 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:05.284186 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-85d9859f9-jpb4r" podUID="f6462139-e4e3-45ba-91cf-f06429e6196a" containerName="console" containerID="cri-o://bef0ff1f903135633f73401377f935d6eb01f04f8fff8e2afbc708d63debc2e6" gracePeriod=15 Jul 21 14:20:05.562077 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:05.562040 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85d9859f9-jpb4r" Jul 21 14:20:05.606220 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:05.606163 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f6462139-e4e3-45ba-91cf-f06429e6196a-console-config\") pod \"f6462139-e4e3-45ba-91cf-f06429e6196a\" (UID: \"f6462139-e4e3-45ba-91cf-f06429e6196a\") " Jul 21 14:20:05.606220 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:05.606221 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f6462139-e4e3-45ba-91cf-f06429e6196a-console-oauth-config\") pod \"f6462139-e4e3-45ba-91cf-f06429e6196a\" (UID: \"f6462139-e4e3-45ba-91cf-f06429e6196a\") " Jul 21 14:20:05.606556 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:05.606254 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f6462139-e4e3-45ba-91cf-f06429e6196a-oauth-serving-cert\") pod \"f6462139-e4e3-45ba-91cf-f06429e6196a\" (UID: \"f6462139-e4e3-45ba-91cf-f06429e6196a\") " Jul 21 14:20:05.606556 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:05.606285 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6462139-e4e3-45ba-91cf-f06429e6196a-trusted-ca-bundle\") pod \"f6462139-e4e3-45ba-91cf-f06429e6196a\" (UID: \"f6462139-e4e3-45ba-91cf-f06429e6196a\") " Jul 21 14:20:05.606556 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:05.606321 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f6462139-e4e3-45ba-91cf-f06429e6196a-service-ca\") pod \"f6462139-e4e3-45ba-91cf-f06429e6196a\" (UID: \"f6462139-e4e3-45ba-91cf-f06429e6196a\") " Jul 21 14:20:05.606556 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:05.606369 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f6462139-e4e3-45ba-91cf-f06429e6196a-console-serving-cert\") pod \"f6462139-e4e3-45ba-91cf-f06429e6196a\" (UID: \"f6462139-e4e3-45ba-91cf-f06429e6196a\") " Jul 21 14:20:05.606556 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:05.606435 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m6m25\" (UniqueName: \"kubernetes.io/projected/f6462139-e4e3-45ba-91cf-f06429e6196a-kube-api-access-m6m25\") pod \"f6462139-e4e3-45ba-91cf-f06429e6196a\" (UID: \"f6462139-e4e3-45ba-91cf-f06429e6196a\") " Jul 21 14:20:05.606854 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:05.606819 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6462139-e4e3-45ba-91cf-f06429e6196a-console-config" (OuterVolumeSpecName: "console-config") pod "f6462139-e4e3-45ba-91cf-f06429e6196a" (UID: "f6462139-e4e3-45ba-91cf-f06429e6196a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 14:20:05.606854 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:05.606836 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6462139-e4e3-45ba-91cf-f06429e6196a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f6462139-e4e3-45ba-91cf-f06429e6196a" (UID: "f6462139-e4e3-45ba-91cf-f06429e6196a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 14:20:05.607000 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:05.606882 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6462139-e4e3-45ba-91cf-f06429e6196a-service-ca" (OuterVolumeSpecName: "service-ca") pod "f6462139-e4e3-45ba-91cf-f06429e6196a" (UID: "f6462139-e4e3-45ba-91cf-f06429e6196a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 14:20:05.607000 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:05.606888 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6462139-e4e3-45ba-91cf-f06429e6196a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f6462139-e4e3-45ba-91cf-f06429e6196a" (UID: "f6462139-e4e3-45ba-91cf-f06429e6196a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 14:20:05.609329 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:05.609275 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6462139-e4e3-45ba-91cf-f06429e6196a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f6462139-e4e3-45ba-91cf-f06429e6196a" (UID: "f6462139-e4e3-45ba-91cf-f06429e6196a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 14:20:05.609329 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:05.609312 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6462139-e4e3-45ba-91cf-f06429e6196a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f6462139-e4e3-45ba-91cf-f06429e6196a" (UID: "f6462139-e4e3-45ba-91cf-f06429e6196a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 14:20:05.609529 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:05.609292 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6462139-e4e3-45ba-91cf-f06429e6196a-kube-api-access-m6m25" (OuterVolumeSpecName: "kube-api-access-m6m25") pod "f6462139-e4e3-45ba-91cf-f06429e6196a" (UID: "f6462139-e4e3-45ba-91cf-f06429e6196a"). InnerVolumeSpecName "kube-api-access-m6m25". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 14:20:05.708094 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:05.708050 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f6462139-e4e3-45ba-91cf-f06429e6196a-console-serving-cert\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:20:05.708094 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:05.708082 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m6m25\" (UniqueName: \"kubernetes.io/projected/f6462139-e4e3-45ba-91cf-f06429e6196a-kube-api-access-m6m25\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:20:05.708094 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:05.708092 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f6462139-e4e3-45ba-91cf-f06429e6196a-console-config\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:20:05.708094 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:05.708103 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f6462139-e4e3-45ba-91cf-f06429e6196a-console-oauth-config\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:20:05.708094 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:05.708112 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f6462139-e4e3-45ba-91cf-f06429e6196a-oauth-serving-cert\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:20:05.708395 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:05.708121 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6462139-e4e3-45ba-91cf-f06429e6196a-trusted-ca-bundle\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:20:05.708395 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:05.708129 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f6462139-e4e3-45ba-91cf-f06429e6196a-service-ca\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:20:06.326635 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:06.326592 2576 generic.go:356] "Generic (PLEG): container finished" podID="f6462139-e4e3-45ba-91cf-f06429e6196a" containerID="bef0ff1f903135633f73401377f935d6eb01f04f8fff8e2afbc708d63debc2e6" exitCode=0 Jul 21 14:20:06.327191 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:06.326644 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85d9859f9-jpb4r" Jul 21 14:20:06.327191 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:06.326677 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85d9859f9-jpb4r" event={"ID":"f6462139-e4e3-45ba-91cf-f06429e6196a","Type":"ContainerDied","Data":"bef0ff1f903135633f73401377f935d6eb01f04f8fff8e2afbc708d63debc2e6"} Jul 21 14:20:06.327191 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:06.326749 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85d9859f9-jpb4r" event={"ID":"f6462139-e4e3-45ba-91cf-f06429e6196a","Type":"ContainerDied","Data":"503b8c58f3401e493c760ae8dedb7763760659f76c39f87aa4e906e3dd229ab2"} Jul 21 14:20:06.327191 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:06.326804 2576 scope.go:117] "RemoveContainer" containerID="bef0ff1f903135633f73401377f935d6eb01f04f8fff8e2afbc708d63debc2e6" Jul 21 14:20:06.337117 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:06.337097 2576 scope.go:117] "RemoveContainer" containerID="bef0ff1f903135633f73401377f935d6eb01f04f8fff8e2afbc708d63debc2e6" Jul 21 14:20:06.337515 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:20:06.337496 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bef0ff1f903135633f73401377f935d6eb01f04f8fff8e2afbc708d63debc2e6\": container with ID starting with bef0ff1f903135633f73401377f935d6eb01f04f8fff8e2afbc708d63debc2e6 not found: ID does not exist" containerID="bef0ff1f903135633f73401377f935d6eb01f04f8fff8e2afbc708d63debc2e6" Jul 21 14:20:06.337565 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:06.337524 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bef0ff1f903135633f73401377f935d6eb01f04f8fff8e2afbc708d63debc2e6"} err="failed to get container status \"bef0ff1f903135633f73401377f935d6eb01f04f8fff8e2afbc708d63debc2e6\": rpc error: code = NotFound desc = could not find container \"bef0ff1f903135633f73401377f935d6eb01f04f8fff8e2afbc708d63debc2e6\": container with ID starting with bef0ff1f903135633f73401377f935d6eb01f04f8fff8e2afbc708d63debc2e6 not found: ID does not exist" Jul 21 14:20:06.355846 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:06.355790 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85d9859f9-jpb4r"] Jul 21 14:20:06.360716 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:06.360668 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-85d9859f9-jpb4r"] Jul 21 14:20:07.526239 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:07.526172 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6462139-e4e3-45ba-91cf-f06429e6196a" path="/var/lib/kubelet/pods/f6462139-e4e3-45ba-91cf-f06429e6196a/volumes" Jul 21 14:20:29.162320 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:29.162270 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 21 14:20:29.162898 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:29.162812 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6462139-e4e3-45ba-91cf-f06429e6196a" containerName="console" Jul 21 14:20:29.162898 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:29.162837 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6462139-e4e3-45ba-91cf-f06429e6196a" containerName="console" Jul 21 14:20:29.163002 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:29.162948 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6462139-e4e3-45ba-91cf-f06429e6196a" containerName="console" Jul 21 14:20:29.166584 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:29.166556 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 21 14:20:29.173049 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:29.172612 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 21 14:20:29.173049 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:29.172637 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 21 14:20:29.173049 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:29.172672 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 21 14:20:29.173049 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:29.172735 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 21 14:20:29.173049 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:29.172746 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 21 14:20:29.173049 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:29.172613 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-p755w\"" Jul 21 14:20:29.173557 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:29.173375 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 21 14:20:29.176463 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:29.176416 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 21 14:20:29.176684 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:29.176531 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 21 14:20:29.181287 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:29.181251 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 21 14:20:29.181709 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:29.181687 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 21 14:20:29.230071 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:29.230036 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k485m\" (UniqueName: \"kubernetes.io/projected/900ea2a0-98aa-41bc-b025-d1d579442fb1-kube-api-access-k485m\") pod \"alertmanager-main-0\" (UID: \"900ea2a0-98aa-41bc-b025-d1d579442fb1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 14:20:29.230264 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:29.230085 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/900ea2a0-98aa-41bc-b025-d1d579442fb1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"900ea2a0-98aa-41bc-b025-d1d579442fb1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 14:20:29.230264 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:29.230107 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/900ea2a0-98aa-41bc-b025-d1d579442fb1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"900ea2a0-98aa-41bc-b025-d1d579442fb1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 14:20:29.230264 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:29.230149 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/900ea2a0-98aa-41bc-b025-d1d579442fb1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"900ea2a0-98aa-41bc-b025-d1d579442fb1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 14:20:29.230264 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:29.230180 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/900ea2a0-98aa-41bc-b025-d1d579442fb1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"900ea2a0-98aa-41bc-b025-d1d579442fb1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 14:20:29.230264 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:29.230207 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/900ea2a0-98aa-41bc-b025-d1d579442fb1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"900ea2a0-98aa-41bc-b025-d1d579442fb1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 14:20:29.230264 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:29.230224 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/900ea2a0-98aa-41bc-b025-d1d579442fb1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"900ea2a0-98aa-41bc-b025-d1d579442fb1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 14:20:29.230264 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:29.230243 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/900ea2a0-98aa-41bc-b025-d1d579442fb1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"900ea2a0-98aa-41bc-b025-d1d579442fb1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 14:20:29.230264 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:29.230259 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/900ea2a0-98aa-41bc-b025-d1d579442fb1-config-out\") pod \"alertmanager-main-0\" (UID: \"900ea2a0-98aa-41bc-b025-d1d579442fb1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 14:20:29.230561 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:29.230277 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/900ea2a0-98aa-41bc-b025-d1d579442fb1-web-config\") pod \"alertmanager-main-0\" (UID: \"900ea2a0-98aa-41bc-b025-d1d579442fb1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 14:20:29.230561 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:29.230300 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/900ea2a0-98aa-41bc-b025-d1d579442fb1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"900ea2a0-98aa-41bc-b025-d1d579442fb1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 14:20:29.230561 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:29.230355 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/900ea2a0-98aa-41bc-b025-d1d579442fb1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"900ea2a0-98aa-41bc-b025-d1d579442fb1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 14:20:29.230561 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:29.230393 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/900ea2a0-98aa-41bc-b025-d1d579442fb1-config-volume\") pod \"alertmanager-main-0\" (UID: \"900ea2a0-98aa-41bc-b025-d1d579442fb1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 14:20:29.331717 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:29.331652 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/900ea2a0-98aa-41bc-b025-d1d579442fb1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"900ea2a0-98aa-41bc-b025-d1d579442fb1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 14:20:29.331717 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:29.331723 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/900ea2a0-98aa-41bc-b025-d1d579442fb1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"900ea2a0-98aa-41bc-b025-d1d579442fb1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 14:20:29.332061 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:29.331753 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/900ea2a0-98aa-41bc-b025-d1d579442fb1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"900ea2a0-98aa-41bc-b025-d1d579442fb1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 14:20:29.332061 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:29.331811 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/900ea2a0-98aa-41bc-b025-d1d579442fb1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"900ea2a0-98aa-41bc-b025-d1d579442fb1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 14:20:29.332061 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:29.332011 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/900ea2a0-98aa-41bc-b025-d1d579442fb1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"900ea2a0-98aa-41bc-b025-d1d579442fb1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 14:20:29.332061 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:29.332055 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/900ea2a0-98aa-41bc-b025-d1d579442fb1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"900ea2a0-98aa-41bc-b025-d1d579442fb1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 14:20:29.332277 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:29.332188 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/900ea2a0-98aa-41bc-b025-d1d579442fb1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"900ea2a0-98aa-41bc-b025-d1d579442fb1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 14:20:29.332330 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:29.332292 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/900ea2a0-98aa-41bc-b025-d1d579442fb1-config-out\") pod \"alertmanager-main-0\" (UID: \"900ea2a0-98aa-41bc-b025-d1d579442fb1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 14:20:29.332390 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:29.332333 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/900ea2a0-98aa-41bc-b025-d1d579442fb1-web-config\") pod \"alertmanager-main-0\" (UID: \"900ea2a0-98aa-41bc-b025-d1d579442fb1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 14:20:29.332441 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:29.332375 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/900ea2a0-98aa-41bc-b025-d1d579442fb1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"900ea2a0-98aa-41bc-b025-d1d579442fb1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 14:20:29.332441 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:29.332426 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/900ea2a0-98aa-41bc-b025-d1d579442fb1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"900ea2a0-98aa-41bc-b025-d1d579442fb1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 14:20:29.332538 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:29.332476 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/900ea2a0-98aa-41bc-b025-d1d579442fb1-config-volume\") pod \"alertmanager-main-0\" (UID: \"900ea2a0-98aa-41bc-b025-d1d579442fb1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 14:20:29.332596 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:29.332544 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k485m\" (UniqueName: \"kubernetes.io/projected/900ea2a0-98aa-41bc-b025-d1d579442fb1-kube-api-access-k485m\") pod \"alertmanager-main-0\" (UID: \"900ea2a0-98aa-41bc-b025-d1d579442fb1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 14:20:29.333258 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:29.333220 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/900ea2a0-98aa-41bc-b025-d1d579442fb1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"900ea2a0-98aa-41bc-b025-d1d579442fb1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 14:20:29.334759 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:29.334715 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/900ea2a0-98aa-41bc-b025-d1d579442fb1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"900ea2a0-98aa-41bc-b025-d1d579442fb1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 14:20:29.335472 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:29.335437 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/900ea2a0-98aa-41bc-b025-d1d579442fb1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"900ea2a0-98aa-41bc-b025-d1d579442fb1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 14:20:29.335632 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:29.335499 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/900ea2a0-98aa-41bc-b025-d1d579442fb1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"900ea2a0-98aa-41bc-b025-d1d579442fb1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 14:20:29.335700 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:29.335625 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/900ea2a0-98aa-41bc-b025-d1d579442fb1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"900ea2a0-98aa-41bc-b025-d1d579442fb1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 14:20:29.335700 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:29.335652 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/900ea2a0-98aa-41bc-b025-d1d579442fb1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"900ea2a0-98aa-41bc-b025-d1d579442fb1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 14:20:29.337181 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:29.335738 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/900ea2a0-98aa-41bc-b025-d1d579442fb1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"900ea2a0-98aa-41bc-b025-d1d579442fb1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 14:20:29.337181 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:29.335898 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/900ea2a0-98aa-41bc-b025-d1d579442fb1-config-out\") pod \"alertmanager-main-0\" (UID: \"900ea2a0-98aa-41bc-b025-d1d579442fb1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 14:20:29.337181 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:29.336972 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/900ea2a0-98aa-41bc-b025-d1d579442fb1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"900ea2a0-98aa-41bc-b025-d1d579442fb1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 14:20:29.338548 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:29.338482 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/900ea2a0-98aa-41bc-b025-d1d579442fb1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"900ea2a0-98aa-41bc-b025-d1d579442fb1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 14:20:29.338844 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:29.338820 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/900ea2a0-98aa-41bc-b025-d1d579442fb1-config-volume\") pod \"alertmanager-main-0\" (UID: \"900ea2a0-98aa-41bc-b025-d1d579442fb1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 14:20:29.338965 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:29.338837 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/900ea2a0-98aa-41bc-b025-d1d579442fb1-web-config\") pod \"alertmanager-main-0\" (UID: \"900ea2a0-98aa-41bc-b025-d1d579442fb1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 14:20:29.343289 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:29.343249 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k485m\" (UniqueName: \"kubernetes.io/projected/900ea2a0-98aa-41bc-b025-d1d579442fb1-kube-api-access-k485m\") pod \"alertmanager-main-0\" (UID: \"900ea2a0-98aa-41bc-b025-d1d579442fb1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 14:20:29.487449 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:29.487403 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 21 14:20:29.671333 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:29.671280 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 21 14:20:29.674575 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:20:29.674499 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod900ea2a0_98aa_41bc_b025_d1d579442fb1.slice/crio-9fdb461108cd1b7445a7f802d76a251f1022c58e8755691be95b464a9432730f WatchSource:0}: Error finding container 9fdb461108cd1b7445a7f802d76a251f1022c58e8755691be95b464a9432730f: Status 404 returned error can't find the container with id 9fdb461108cd1b7445a7f802d76a251f1022c58e8755691be95b464a9432730f Jul 21 14:20:30.436903 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:30.436860 2576 generic.go:356] "Generic (PLEG): container finished" podID="900ea2a0-98aa-41bc-b025-d1d579442fb1" containerID="914155a1a1518fa3d0b5f3b4e4a5fd7c73cd16aeb37951ab6b21372b4f410dd8" exitCode=0 Jul 21 14:20:30.437302 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:30.436916 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"900ea2a0-98aa-41bc-b025-d1d579442fb1","Type":"ContainerDied","Data":"914155a1a1518fa3d0b5f3b4e4a5fd7c73cd16aeb37951ab6b21372b4f410dd8"} Jul 21 14:20:30.437302 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:30.436984 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"900ea2a0-98aa-41bc-b025-d1d579442fb1","Type":"ContainerStarted","Data":"9fdb461108cd1b7445a7f802d76a251f1022c58e8755691be95b464a9432730f"} Jul 21 14:20:32.453639 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:32.453580 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"900ea2a0-98aa-41bc-b025-d1d579442fb1","Type":"ContainerStarted","Data":"fd38872f37275155160e5ad8d6ca953fa2233cf2ef09432b826c62aa618935ca"} Jul 21 14:20:32.454295 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:32.453692 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"900ea2a0-98aa-41bc-b025-d1d579442fb1","Type":"ContainerStarted","Data":"1092f05147439662856764ecabfa7ede7e3c81f67fdd62e6147028f4289aa31f"} Jul 21 14:20:32.454295 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:32.453739 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"900ea2a0-98aa-41bc-b025-d1d579442fb1","Type":"ContainerStarted","Data":"11f1de334d56d889b4d2722727d60eb0a7a41929b8953e47b813b960a0e0956f"} Jul 21 14:20:32.454295 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:32.453802 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"900ea2a0-98aa-41bc-b025-d1d579442fb1","Type":"ContainerStarted","Data":"7efab578c972e4376253380415e903a75d7006fff2234aa2757275a007772988"} Jul 21 14:20:32.454295 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:32.453854 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"900ea2a0-98aa-41bc-b025-d1d579442fb1","Type":"ContainerStarted","Data":"85f4ae9f57e2380d55af2423cc6f725e85d9d40ac8b93d13f3c27b58c2625d9e"} Jul 21 14:20:32.454295 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:32.453897 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"900ea2a0-98aa-41bc-b025-d1d579442fb1","Type":"ContainerStarted","Data":"88cd58b503c3cdd1f030fa45bae39853a33667a4ff2985843ee7376228e4b3bf"} Jul 21 14:20:32.486296 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:32.486217 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.053277246 podStartE2EDuration="3.486195706s" totalImagesPullingTime="1.409181116s" totalInitContainerRuntime="23.737344ms" isStatefulPod=false podCreationTimestamp="2026-07-21 14:20:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:20:32.484410733 +0000 UTC m=+159.502314308" watchObservedRunningTime="2026-07-21 14:20:32.486195706 +0000 UTC m=+159.504099280" Jul 21 14:20:43.228927 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:20:43.228864 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57874bc659-zcbrz"] Jul 21 14:21:08.253721 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:21:08.253653 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-57874bc659-zcbrz" podUID="b345cd05-5005-4b84-9f1b-2af62b53b108" containerName="console" containerID="cri-o://bbc0e3a58ec9a77ac0a546309a171cb5b399a714ea4cfc4d9ce5876e0ad941c9" gracePeriod=15 Jul 21 14:21:08.507493 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:21:08.507385 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57874bc659-zcbrz" Jul 21 14:21:08.603569 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:21:08.603540 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b345cd05-5005-4b84-9f1b-2af62b53b108-console-oauth-config\") pod \"b345cd05-5005-4b84-9f1b-2af62b53b108\" (UID: \"b345cd05-5005-4b84-9f1b-2af62b53b108\") " Jul 21 14:21:08.603765 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:21:08.603577 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b345cd05-5005-4b84-9f1b-2af62b53b108-oauth-serving-cert\") pod \"b345cd05-5005-4b84-9f1b-2af62b53b108\" (UID: \"b345cd05-5005-4b84-9f1b-2af62b53b108\") " Jul 21 14:21:08.603765 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:21:08.603602 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kkvsv\" (UniqueName: \"kubernetes.io/projected/b345cd05-5005-4b84-9f1b-2af62b53b108-kube-api-access-kkvsv\") pod \"b345cd05-5005-4b84-9f1b-2af62b53b108\" (UID: \"b345cd05-5005-4b84-9f1b-2af62b53b108\") " Jul 21 14:21:08.603765 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:21:08.603621 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b345cd05-5005-4b84-9f1b-2af62b53b108-trusted-ca-bundle\") pod \"b345cd05-5005-4b84-9f1b-2af62b53b108\" (UID: \"b345cd05-5005-4b84-9f1b-2af62b53b108\") " Jul 21 14:21:08.603765 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:21:08.603649 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b345cd05-5005-4b84-9f1b-2af62b53b108-service-ca\") pod \"b345cd05-5005-4b84-9f1b-2af62b53b108\" (UID: \"b345cd05-5005-4b84-9f1b-2af62b53b108\") " Jul 21 14:21:08.603765 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:21:08.603673 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b345cd05-5005-4b84-9f1b-2af62b53b108-console-serving-cert\") pod \"b345cd05-5005-4b84-9f1b-2af62b53b108\" (UID: \"b345cd05-5005-4b84-9f1b-2af62b53b108\") " Jul 21 14:21:08.603765 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:21:08.603714 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b345cd05-5005-4b84-9f1b-2af62b53b108-console-config\") pod \"b345cd05-5005-4b84-9f1b-2af62b53b108\" (UID: \"b345cd05-5005-4b84-9f1b-2af62b53b108\") " Jul 21 14:21:08.604205 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:21:08.604175 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b345cd05-5005-4b84-9f1b-2af62b53b108-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b345cd05-5005-4b84-9f1b-2af62b53b108" (UID: "b345cd05-5005-4b84-9f1b-2af62b53b108"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 14:21:08.604298 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:21:08.604209 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b345cd05-5005-4b84-9f1b-2af62b53b108-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b345cd05-5005-4b84-9f1b-2af62b53b108" (UID: "b345cd05-5005-4b84-9f1b-2af62b53b108"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 14:21:08.604407 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:21:08.604382 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b345cd05-5005-4b84-9f1b-2af62b53b108-console-config" (OuterVolumeSpecName: "console-config") pod "b345cd05-5005-4b84-9f1b-2af62b53b108" (UID: "b345cd05-5005-4b84-9f1b-2af62b53b108"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 14:21:08.604407 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:21:08.604390 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b345cd05-5005-4b84-9f1b-2af62b53b108-service-ca" (OuterVolumeSpecName: "service-ca") pod "b345cd05-5005-4b84-9f1b-2af62b53b108" (UID: "b345cd05-5005-4b84-9f1b-2af62b53b108"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 14:21:08.606089 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:21:08.606066 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b345cd05-5005-4b84-9f1b-2af62b53b108-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b345cd05-5005-4b84-9f1b-2af62b53b108" (UID: "b345cd05-5005-4b84-9f1b-2af62b53b108"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 14:21:08.606247 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:21:08.606219 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b345cd05-5005-4b84-9f1b-2af62b53b108-kube-api-access-kkvsv" (OuterVolumeSpecName: "kube-api-access-kkvsv") pod "b345cd05-5005-4b84-9f1b-2af62b53b108" (UID: "b345cd05-5005-4b84-9f1b-2af62b53b108"). InnerVolumeSpecName "kube-api-access-kkvsv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 14:21:08.606247 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:21:08.606232 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b345cd05-5005-4b84-9f1b-2af62b53b108-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b345cd05-5005-4b84-9f1b-2af62b53b108" (UID: "b345cd05-5005-4b84-9f1b-2af62b53b108"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 14:21:08.613503 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:21:08.613476 2576 generic.go:356] "Generic (PLEG): container finished" podID="b345cd05-5005-4b84-9f1b-2af62b53b108" containerID="bbc0e3a58ec9a77ac0a546309a171cb5b399a714ea4cfc4d9ce5876e0ad941c9" exitCode=0 Jul 21 14:21:08.613605 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:21:08.613531 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57874bc659-zcbrz" Jul 21 14:21:08.613605 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:21:08.613560 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57874bc659-zcbrz" event={"ID":"b345cd05-5005-4b84-9f1b-2af62b53b108","Type":"ContainerDied","Data":"bbc0e3a58ec9a77ac0a546309a171cb5b399a714ea4cfc4d9ce5876e0ad941c9"} Jul 21 14:21:08.613680 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:21:08.613623 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57874bc659-zcbrz" event={"ID":"b345cd05-5005-4b84-9f1b-2af62b53b108","Type":"ContainerDied","Data":"a942bf9229b64c217b469440c7ad39203177fef7e5e56b1cd3ba213af38fe4fc"} Jul 21 14:21:08.613680 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:21:08.613653 2576 scope.go:117] "RemoveContainer" containerID="bbc0e3a58ec9a77ac0a546309a171cb5b399a714ea4cfc4d9ce5876e0ad941c9" Jul 21 14:21:08.622822 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:21:08.622792 2576 scope.go:117] "RemoveContainer" containerID="bbc0e3a58ec9a77ac0a546309a171cb5b399a714ea4cfc4d9ce5876e0ad941c9" Jul 21 14:21:08.623219 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:21:08.623199 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bbc0e3a58ec9a77ac0a546309a171cb5b399a714ea4cfc4d9ce5876e0ad941c9\": container with ID starting with bbc0e3a58ec9a77ac0a546309a171cb5b399a714ea4cfc4d9ce5876e0ad941c9 not found: ID does not exist" containerID="bbc0e3a58ec9a77ac0a546309a171cb5b399a714ea4cfc4d9ce5876e0ad941c9" Jul 21 14:21:08.623276 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:21:08.623229 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbc0e3a58ec9a77ac0a546309a171cb5b399a714ea4cfc4d9ce5876e0ad941c9"} err="failed to get container status \"bbc0e3a58ec9a77ac0a546309a171cb5b399a714ea4cfc4d9ce5876e0ad941c9\": rpc error: code = NotFound desc = could not find container \"bbc0e3a58ec9a77ac0a546309a171cb5b399a714ea4cfc4d9ce5876e0ad941c9\": container with ID starting with bbc0e3a58ec9a77ac0a546309a171cb5b399a714ea4cfc4d9ce5876e0ad941c9 not found: ID does not exist" Jul 21 14:21:08.638521 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:21:08.638465 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57874bc659-zcbrz"] Jul 21 14:21:08.642994 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:21:08.642954 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-57874bc659-zcbrz"] Jul 21 14:21:08.705170 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:21:08.705101 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b345cd05-5005-4b84-9f1b-2af62b53b108-oauth-serving-cert\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:21:08.705170 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:21:08.705151 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kkvsv\" (UniqueName: \"kubernetes.io/projected/b345cd05-5005-4b84-9f1b-2af62b53b108-kube-api-access-kkvsv\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:21:08.705170 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:21:08.705167 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b345cd05-5005-4b84-9f1b-2af62b53b108-trusted-ca-bundle\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:21:08.705170 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:21:08.705181 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b345cd05-5005-4b84-9f1b-2af62b53b108-service-ca\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:21:08.705522 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:21:08.705195 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b345cd05-5005-4b84-9f1b-2af62b53b108-console-serving-cert\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:21:08.705522 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:21:08.705210 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b345cd05-5005-4b84-9f1b-2af62b53b108-console-config\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:21:08.705522 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:21:08.705223 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b345cd05-5005-4b84-9f1b-2af62b53b108-console-oauth-config\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:21:09.525905 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:21:09.525845 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b345cd05-5005-4b84-9f1b-2af62b53b108" path="/var/lib/kubelet/pods/b345cd05-5005-4b84-9f1b-2af62b53b108/volumes" Jul 21 14:22:36.573258 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:22:36.573146 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540slpln"] Jul 21 14:22:36.573940 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:22:36.573633 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b345cd05-5005-4b84-9f1b-2af62b53b108" containerName="console" Jul 21 14:22:36.573940 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:22:36.573655 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b345cd05-5005-4b84-9f1b-2af62b53b108" containerName="console" Jul 21 14:22:36.573940 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:22:36.573769 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b345cd05-5005-4b84-9f1b-2af62b53b108" containerName="console" Jul 21 14:22:36.577280 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:22:36.577249 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540slpln" Jul 21 14:22:36.580350 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:22:36.580321 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 21 14:22:36.580350 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:22:36.580351 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 21 14:22:36.581412 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:22:36.581378 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-nq7dz\"" Jul 21 14:22:36.586684 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:22:36.586649 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540slpln"] Jul 21 14:22:36.707711 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:22:36.707659 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5bk9\" (UniqueName: \"kubernetes.io/projected/2cb18e56-d4bb-4e64-8cf2-a9f467920fba-kube-api-access-x5bk9\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540slpln\" (UID: \"2cb18e56-d4bb-4e64-8cf2-a9f467920fba\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540slpln" Jul 21 14:22:36.708028 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:22:36.707890 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2cb18e56-d4bb-4e64-8cf2-a9f467920fba-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540slpln\" (UID: \"2cb18e56-d4bb-4e64-8cf2-a9f467920fba\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540slpln" Jul 21 14:22:36.708028 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:22:36.707966 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2cb18e56-d4bb-4e64-8cf2-a9f467920fba-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540slpln\" (UID: \"2cb18e56-d4bb-4e64-8cf2-a9f467920fba\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540slpln" Jul 21 14:22:36.809157 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:22:36.809091 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2cb18e56-d4bb-4e64-8cf2-a9f467920fba-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540slpln\" (UID: \"2cb18e56-d4bb-4e64-8cf2-a9f467920fba\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540slpln" Jul 21 14:22:36.809157 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:22:36.809157 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2cb18e56-d4bb-4e64-8cf2-a9f467920fba-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540slpln\" (UID: \"2cb18e56-d4bb-4e64-8cf2-a9f467920fba\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540slpln" Jul 21 14:22:36.809420 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:22:36.809194 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5bk9\" (UniqueName: \"kubernetes.io/projected/2cb18e56-d4bb-4e64-8cf2-a9f467920fba-kube-api-access-x5bk9\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540slpln\" (UID: \"2cb18e56-d4bb-4e64-8cf2-a9f467920fba\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540slpln" Jul 21 14:22:36.809562 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:22:36.809541 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2cb18e56-d4bb-4e64-8cf2-a9f467920fba-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540slpln\" (UID: \"2cb18e56-d4bb-4e64-8cf2-a9f467920fba\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540slpln" Jul 21 14:22:36.809604 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:22:36.809569 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2cb18e56-d4bb-4e64-8cf2-a9f467920fba-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540slpln\" (UID: \"2cb18e56-d4bb-4e64-8cf2-a9f467920fba\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540slpln" Jul 21 14:22:36.820528 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:22:36.820470 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5bk9\" (UniqueName: \"kubernetes.io/projected/2cb18e56-d4bb-4e64-8cf2-a9f467920fba-kube-api-access-x5bk9\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540slpln\" (UID: \"2cb18e56-d4bb-4e64-8cf2-a9f467920fba\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540slpln" Jul 21 14:22:36.889259 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:22:36.889095 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540slpln" Jul 21 14:22:37.075772 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:22:37.075682 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540slpln"] Jul 21 14:22:37.081338 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:22:37.081281 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cb18e56_d4bb_4e64_8cf2_a9f467920fba.slice/crio-5d56289cb693525bf52ce478b50186e5c0eefe0a6af566ac99c1cffd49356709 WatchSource:0}: Error finding container 5d56289cb693525bf52ce478b50186e5c0eefe0a6af566ac99c1cffd49356709: Status 404 returned error can't find the container with id 5d56289cb693525bf52ce478b50186e5c0eefe0a6af566ac99c1cffd49356709 Jul 21 14:22:38.017028 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:22:38.016989 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540slpln" event={"ID":"2cb18e56-d4bb-4e64-8cf2-a9f467920fba","Type":"ContainerStarted","Data":"5d56289cb693525bf52ce478b50186e5c0eefe0a6af566ac99c1cffd49356709"} Jul 21 14:22:45.056389 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:22:45.056341 2576 generic.go:356] "Generic (PLEG): container finished" podID="2cb18e56-d4bb-4e64-8cf2-a9f467920fba" containerID="aab42a0da26e055f3b1d96e8e2938de69fa1992cfd9932f2dcdeb2fa5e21fb11" exitCode=0 Jul 21 14:22:45.056875 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:22:45.056437 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540slpln" event={"ID":"2cb18e56-d4bb-4e64-8cf2-a9f467920fba","Type":"ContainerDied","Data":"aab42a0da26e055f3b1d96e8e2938de69fa1992cfd9932f2dcdeb2fa5e21fb11"} Jul 21 14:22:48.076414 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:22:48.076355 2576 generic.go:356] "Generic (PLEG): container finished" podID="2cb18e56-d4bb-4e64-8cf2-a9f467920fba" containerID="0c3e9ee78de75d9e81199106f5c1b28a2bfbe11734ee49ad31c9e548914d4d70" exitCode=0 Jul 21 14:22:48.076414 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:22:48.076402 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540slpln" event={"ID":"2cb18e56-d4bb-4e64-8cf2-a9f467920fba","Type":"ContainerDied","Data":"0c3e9ee78de75d9e81199106f5c1b28a2bfbe11734ee49ad31c9e548914d4d70"} Jul 21 14:22:53.375683 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:22:53.375631 2576 kubelet.go:1648] "Image garbage collection succeeded" Jul 21 14:22:57.120602 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:22:57.120564 2576 generic.go:356] "Generic (PLEG): container finished" podID="2cb18e56-d4bb-4e64-8cf2-a9f467920fba" containerID="eed0daffceea11a41afa3f0053af950459deaa8beea10e881a2addf3be082a36" exitCode=0 Jul 21 14:22:57.121018 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:22:57.120650 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540slpln" event={"ID":"2cb18e56-d4bb-4e64-8cf2-a9f467920fba","Type":"ContainerDied","Data":"eed0daffceea11a41afa3f0053af950459deaa8beea10e881a2addf3be082a36"} Jul 21 14:22:58.264842 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:22:58.264802 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540slpln" Jul 21 14:22:58.418125 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:22:58.418030 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x5bk9\" (UniqueName: \"kubernetes.io/projected/2cb18e56-d4bb-4e64-8cf2-a9f467920fba-kube-api-access-x5bk9\") pod \"2cb18e56-d4bb-4e64-8cf2-a9f467920fba\" (UID: \"2cb18e56-d4bb-4e64-8cf2-a9f467920fba\") " Jul 21 14:22:58.418125 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:22:58.418086 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2cb18e56-d4bb-4e64-8cf2-a9f467920fba-bundle\") pod \"2cb18e56-d4bb-4e64-8cf2-a9f467920fba\" (UID: \"2cb18e56-d4bb-4e64-8cf2-a9f467920fba\") " Jul 21 14:22:58.418404 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:22:58.418144 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2cb18e56-d4bb-4e64-8cf2-a9f467920fba-util\") pod \"2cb18e56-d4bb-4e64-8cf2-a9f467920fba\" (UID: \"2cb18e56-d4bb-4e64-8cf2-a9f467920fba\") " Jul 21 14:22:58.418838 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:22:58.418810 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2cb18e56-d4bb-4e64-8cf2-a9f467920fba-bundle" (OuterVolumeSpecName: "bundle") pod "2cb18e56-d4bb-4e64-8cf2-a9f467920fba" (UID: "2cb18e56-d4bb-4e64-8cf2-a9f467920fba"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:22:58.420525 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:22:58.420481 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2cb18e56-d4bb-4e64-8cf2-a9f467920fba-kube-api-access-x5bk9" (OuterVolumeSpecName: "kube-api-access-x5bk9") pod "2cb18e56-d4bb-4e64-8cf2-a9f467920fba" (UID: "2cb18e56-d4bb-4e64-8cf2-a9f467920fba"). InnerVolumeSpecName "kube-api-access-x5bk9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 14:22:58.423185 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:22:58.423141 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2cb18e56-d4bb-4e64-8cf2-a9f467920fba-util" (OuterVolumeSpecName: "util") pod "2cb18e56-d4bb-4e64-8cf2-a9f467920fba" (UID: "2cb18e56-d4bb-4e64-8cf2-a9f467920fba"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:22:58.519183 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:22:58.519138 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x5bk9\" (UniqueName: \"kubernetes.io/projected/2cb18e56-d4bb-4e64-8cf2-a9f467920fba-kube-api-access-x5bk9\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:22:58.519183 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:22:58.519174 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2cb18e56-d4bb-4e64-8cf2-a9f467920fba-bundle\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:22:58.519183 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:22:58.519184 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2cb18e56-d4bb-4e64-8cf2-a9f467920fba-util\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:22:59.130757 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:22:59.130720 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540slpln" event={"ID":"2cb18e56-d4bb-4e64-8cf2-a9f467920fba","Type":"ContainerDied","Data":"5d56289cb693525bf52ce478b50186e5c0eefe0a6af566ac99c1cffd49356709"} Jul 21 14:22:59.130949 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:22:59.130767 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540slpln" Jul 21 14:22:59.130949 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:22:59.130801 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5d56289cb693525bf52ce478b50186e5c0eefe0a6af566ac99c1cffd49356709" Jul 21 14:23:04.710035 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:04.709984 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7gxgr"] Jul 21 14:23:04.710565 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:04.710368 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2cb18e56-d4bb-4e64-8cf2-a9f467920fba" containerName="util" Jul 21 14:23:04.710565 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:04.710381 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cb18e56-d4bb-4e64-8cf2-a9f467920fba" containerName="util" Jul 21 14:23:04.710565 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:04.710403 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2cb18e56-d4bb-4e64-8cf2-a9f467920fba" containerName="pull" Jul 21 14:23:04.710565 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:04.710408 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cb18e56-d4bb-4e64-8cf2-a9f467920fba" containerName="pull" Jul 21 14:23:04.710565 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:04.710420 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2cb18e56-d4bb-4e64-8cf2-a9f467920fba" containerName="extract" Jul 21 14:23:04.710565 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:04.710428 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cb18e56-d4bb-4e64-8cf2-a9f467920fba" containerName="extract" Jul 21 14:23:04.710565 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:04.710488 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="2cb18e56-d4bb-4e64-8cf2-a9f467920fba" containerName="extract" Jul 21 14:23:04.716475 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:04.716448 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7gxgr" Jul 21 14:23:04.719364 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:04.719322 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-8zjnt\"" Jul 21 14:23:04.719364 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:04.719351 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 21 14:23:04.719597 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:04.719322 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 21 14:23:04.726800 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:04.726740 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7gxgr"] Jul 21 14:23:04.880542 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:04.880484 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66cq9\" (UniqueName: \"kubernetes.io/projected/c33e0e00-5c4f-4b05-8c8d-cb1d54f7e08f-kube-api-access-66cq9\") pod \"cert-manager-operator-controller-manager-55c444bf86-7gxgr\" (UID: \"c33e0e00-5c4f-4b05-8c8d-cb1d54f7e08f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7gxgr" Jul 21 14:23:04.880542 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:04.880550 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c33e0e00-5c4f-4b05-8c8d-cb1d54f7e08f-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-7gxgr\" (UID: \"c33e0e00-5c4f-4b05-8c8d-cb1d54f7e08f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7gxgr" Jul 21 14:23:04.982069 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:04.981957 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66cq9\" (UniqueName: \"kubernetes.io/projected/c33e0e00-5c4f-4b05-8c8d-cb1d54f7e08f-kube-api-access-66cq9\") pod \"cert-manager-operator-controller-manager-55c444bf86-7gxgr\" (UID: \"c33e0e00-5c4f-4b05-8c8d-cb1d54f7e08f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7gxgr" Jul 21 14:23:04.982069 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:04.982012 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c33e0e00-5c4f-4b05-8c8d-cb1d54f7e08f-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-7gxgr\" (UID: \"c33e0e00-5c4f-4b05-8c8d-cb1d54f7e08f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7gxgr" Jul 21 14:23:04.982475 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:04.982458 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c33e0e00-5c4f-4b05-8c8d-cb1d54f7e08f-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-7gxgr\" (UID: \"c33e0e00-5c4f-4b05-8c8d-cb1d54f7e08f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7gxgr" Jul 21 14:23:04.993097 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:04.993055 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-66cq9\" (UniqueName: \"kubernetes.io/projected/c33e0e00-5c4f-4b05-8c8d-cb1d54f7e08f-kube-api-access-66cq9\") pod \"cert-manager-operator-controller-manager-55c444bf86-7gxgr\" (UID: \"c33e0e00-5c4f-4b05-8c8d-cb1d54f7e08f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7gxgr" Jul 21 14:23:05.028941 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:05.028894 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7gxgr" Jul 21 14:23:05.214389 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:05.214341 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7gxgr"] Jul 21 14:23:05.217648 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:23:05.217596 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc33e0e00_5c4f_4b05_8c8d_cb1d54f7e08f.slice/crio-ea26e54b92169bb0717b127a32f2c08c1297f446b3543101ac210b7d4fdba528 WatchSource:0}: Error finding container ea26e54b92169bb0717b127a32f2c08c1297f446b3543101ac210b7d4fdba528: Status 404 returned error can't find the container with id ea26e54b92169bb0717b127a32f2c08c1297f446b3543101ac210b7d4fdba528 Jul 21 14:23:05.221718 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:05.221684 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 21 14:23:06.175699 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:06.175648 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7gxgr" event={"ID":"c33e0e00-5c4f-4b05-8c8d-cb1d54f7e08f","Type":"ContainerStarted","Data":"ea26e54b92169bb0717b127a32f2c08c1297f446b3543101ac210b7d4fdba528"} Jul 21 14:23:07.183081 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:07.183031 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7gxgr" event={"ID":"c33e0e00-5c4f-4b05-8c8d-cb1d54f7e08f","Type":"ContainerStarted","Data":"6321f65b1b38e4ca9048f72d9b99875e774a93805fc4f787d4b80cd37b994d84"} Jul 21 14:23:07.209011 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:07.208921 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7gxgr" podStartSLOduration=1.743855237 podStartE2EDuration="3.208897415s" totalImagesPullingTime="1.465042178s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:23:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:23:07.207229602 +0000 UTC m=+314.225133175" watchObservedRunningTime="2026-07-21 14:23:07.208897415 +0000 UTC m=+314.226800989" Jul 21 14:23:08.383901 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:08.383855 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxbrgt"] Jul 21 14:23:08.387101 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:08.387073 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxbrgt" Jul 21 14:23:08.389957 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:08.389912 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 21 14:23:08.389957 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:08.389957 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-nq7dz\"" Jul 21 14:23:08.390278 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:08.389926 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 21 14:23:08.398524 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:08.398470 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxbrgt"] Jul 21 14:23:08.516696 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:08.516613 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f7a8d43-ddf4-4e0d-94df-658673265924-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxbrgt\" (UID: \"6f7a8d43-ddf4-4e0d-94df-658673265924\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxbrgt" Jul 21 14:23:08.517052 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:08.516805 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gfmr\" (UniqueName: \"kubernetes.io/projected/6f7a8d43-ddf4-4e0d-94df-658673265924-kube-api-access-5gfmr\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxbrgt\" (UID: \"6f7a8d43-ddf4-4e0d-94df-658673265924\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxbrgt" Jul 21 14:23:08.517052 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:08.516914 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f7a8d43-ddf4-4e0d-94df-658673265924-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxbrgt\" (UID: \"6f7a8d43-ddf4-4e0d-94df-658673265924\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxbrgt" Jul 21 14:23:08.618338 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:08.618274 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gfmr\" (UniqueName: \"kubernetes.io/projected/6f7a8d43-ddf4-4e0d-94df-658673265924-kube-api-access-5gfmr\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxbrgt\" (UID: \"6f7a8d43-ddf4-4e0d-94df-658673265924\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxbrgt" Jul 21 14:23:08.618338 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:08.618342 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f7a8d43-ddf4-4e0d-94df-658673265924-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxbrgt\" (UID: \"6f7a8d43-ddf4-4e0d-94df-658673265924\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxbrgt" Jul 21 14:23:08.618669 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:08.618504 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f7a8d43-ddf4-4e0d-94df-658673265924-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxbrgt\" (UID: \"6f7a8d43-ddf4-4e0d-94df-658673265924\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxbrgt" Jul 21 14:23:08.618973 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:08.618938 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f7a8d43-ddf4-4e0d-94df-658673265924-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxbrgt\" (UID: \"6f7a8d43-ddf4-4e0d-94df-658673265924\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxbrgt" Jul 21 14:23:08.619086 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:08.619050 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f7a8d43-ddf4-4e0d-94df-658673265924-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxbrgt\" (UID: \"6f7a8d43-ddf4-4e0d-94df-658673265924\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxbrgt" Jul 21 14:23:08.633577 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:08.633533 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gfmr\" (UniqueName: \"kubernetes.io/projected/6f7a8d43-ddf4-4e0d-94df-658673265924-kube-api-access-5gfmr\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxbrgt\" (UID: \"6f7a8d43-ddf4-4e0d-94df-658673265924\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxbrgt" Jul 21 14:23:08.700548 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:08.700390 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxbrgt" Jul 21 14:23:08.868278 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:08.868064 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxbrgt"] Jul 21 14:23:08.871812 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:23:08.871745 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f7a8d43_ddf4_4e0d_94df_658673265924.slice/crio-271996d518e6df1b04c3de93625eaa8248c12a63b67d510cc108ff4c5924dbb8 WatchSource:0}: Error finding container 271996d518e6df1b04c3de93625eaa8248c12a63b67d510cc108ff4c5924dbb8: Status 404 returned error can't find the container with id 271996d518e6df1b04c3de93625eaa8248c12a63b67d510cc108ff4c5924dbb8 Jul 21 14:23:09.194970 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:09.194910 2576 generic.go:356] "Generic (PLEG): container finished" podID="6f7a8d43-ddf4-4e0d-94df-658673265924" containerID="d034b32fe4d95cedd63ec6ebcd47595875dfb1e7a7b355837579e1ad67450d36" exitCode=0 Jul 21 14:23:09.195231 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:09.195001 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxbrgt" event={"ID":"6f7a8d43-ddf4-4e0d-94df-658673265924","Type":"ContainerDied","Data":"d034b32fe4d95cedd63ec6ebcd47595875dfb1e7a7b355837579e1ad67450d36"} Jul 21 14:23:09.195231 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:09.195069 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxbrgt" event={"ID":"6f7a8d43-ddf4-4e0d-94df-658673265924","Type":"ContainerStarted","Data":"271996d518e6df1b04c3de93625eaa8248c12a63b67d510cc108ff4c5924dbb8"} Jul 21 14:23:09.518445 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:09.518407 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-xrssm"] Jul 21 14:23:09.521060 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:09.521032 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-xrssm" Jul 21 14:23:09.524323 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:09.524293 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-6kb2z\"" Jul 21 14:23:09.524515 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:09.524400 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 21 14:23:09.524570 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:09.524294 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 21 14:23:09.534150 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:09.534105 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-xrssm"] Jul 21 14:23:09.627461 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:09.627391 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrpdz\" (UniqueName: \"kubernetes.io/projected/5d7623e2-e997-43c3-b02b-33f73a330d9d-kube-api-access-xrpdz\") pod \"cert-manager-webhook-6486ffd997-xrssm\" (UID: \"5d7623e2-e997-43c3-b02b-33f73a330d9d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xrssm" Jul 21 14:23:09.627692 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:09.627554 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5d7623e2-e997-43c3-b02b-33f73a330d9d-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-xrssm\" (UID: \"5d7623e2-e997-43c3-b02b-33f73a330d9d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xrssm" Jul 21 14:23:09.729063 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:09.728989 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5d7623e2-e997-43c3-b02b-33f73a330d9d-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-xrssm\" (UID: \"5d7623e2-e997-43c3-b02b-33f73a330d9d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xrssm" Jul 21 14:23:09.729385 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:09.729086 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrpdz\" (UniqueName: \"kubernetes.io/projected/5d7623e2-e997-43c3-b02b-33f73a330d9d-kube-api-access-xrpdz\") pod \"cert-manager-webhook-6486ffd997-xrssm\" (UID: \"5d7623e2-e997-43c3-b02b-33f73a330d9d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xrssm" Jul 21 14:23:09.740164 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:09.740124 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5d7623e2-e997-43c3-b02b-33f73a330d9d-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-xrssm\" (UID: \"5d7623e2-e997-43c3-b02b-33f73a330d9d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xrssm" Jul 21 14:23:09.740337 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:09.740267 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrpdz\" (UniqueName: \"kubernetes.io/projected/5d7623e2-e997-43c3-b02b-33f73a330d9d-kube-api-access-xrpdz\") pod \"cert-manager-webhook-6486ffd997-xrssm\" (UID: \"5d7623e2-e997-43c3-b02b-33f73a330d9d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xrssm" Jul 21 14:23:09.844482 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:09.844367 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-xrssm" Jul 21 14:23:10.002356 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:10.002311 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-xrssm"] Jul 21 14:23:10.005642 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:23:10.005600 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5d7623e2_e997_43c3_b02b_33f73a330d9d.slice/crio-f50b54f1957a6c3e88463ff259f98455b6cd296c720d3cc671dc4feaed66bbe1 WatchSource:0}: Error finding container f50b54f1957a6c3e88463ff259f98455b6cd296c720d3cc671dc4feaed66bbe1: Status 404 returned error can't find the container with id f50b54f1957a6c3e88463ff259f98455b6cd296c720d3cc671dc4feaed66bbe1 Jul 21 14:23:10.201798 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:10.201708 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-xrssm" event={"ID":"5d7623e2-e997-43c3-b02b-33f73a330d9d","Type":"ContainerStarted","Data":"f50b54f1957a6c3e88463ff259f98455b6cd296c720d3cc671dc4feaed66bbe1"} Jul 21 14:23:11.431264 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:11.431210 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-ndhqc"] Jul 21 14:23:11.434706 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:11.434654 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-ndhqc" Jul 21 14:23:11.437691 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:11.437628 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-6blcc\"" Jul 21 14:23:11.446056 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:11.445974 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-ndhqc"] Jul 21 14:23:11.552028 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:11.551973 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9046c60e-6860-49b2-93d0-cfba9f569822-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-ndhqc\" (UID: \"9046c60e-6860-49b2-93d0-cfba9f569822\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-ndhqc" Jul 21 14:23:11.552263 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:11.552035 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjhd7\" (UniqueName: \"kubernetes.io/projected/9046c60e-6860-49b2-93d0-cfba9f569822-kube-api-access-qjhd7\") pod \"cert-manager-cainjector-559cdd8c87-ndhqc\" (UID: \"9046c60e-6860-49b2-93d0-cfba9f569822\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-ndhqc" Jul 21 14:23:11.653189 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:11.653110 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9046c60e-6860-49b2-93d0-cfba9f569822-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-ndhqc\" (UID: \"9046c60e-6860-49b2-93d0-cfba9f569822\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-ndhqc" Jul 21 14:23:11.653189 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:11.653166 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjhd7\" (UniqueName: \"kubernetes.io/projected/9046c60e-6860-49b2-93d0-cfba9f569822-kube-api-access-qjhd7\") pod \"cert-manager-cainjector-559cdd8c87-ndhqc\" (UID: \"9046c60e-6860-49b2-93d0-cfba9f569822\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-ndhqc" Jul 21 14:23:11.668268 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:11.668236 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9046c60e-6860-49b2-93d0-cfba9f569822-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-ndhqc\" (UID: \"9046c60e-6860-49b2-93d0-cfba9f569822\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-ndhqc" Jul 21 14:23:11.668435 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:11.668243 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjhd7\" (UniqueName: \"kubernetes.io/projected/9046c60e-6860-49b2-93d0-cfba9f569822-kube-api-access-qjhd7\") pod \"cert-manager-cainjector-559cdd8c87-ndhqc\" (UID: \"9046c60e-6860-49b2-93d0-cfba9f569822\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-ndhqc" Jul 21 14:23:11.751345 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:11.751287 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-ndhqc" Jul 21 14:23:11.944751 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:11.944677 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-ndhqc"] Jul 21 14:23:11.948599 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:23:11.948547 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9046c60e_6860_49b2_93d0_cfba9f569822.slice/crio-8bff349eae02ad37a33a2419519217ced43bbcdf170aab4ace4a2de059048f8c WatchSource:0}: Error finding container 8bff349eae02ad37a33a2419519217ced43bbcdf170aab4ace4a2de059048f8c: Status 404 returned error can't find the container with id 8bff349eae02ad37a33a2419519217ced43bbcdf170aab4ace4a2de059048f8c Jul 21 14:23:12.213824 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:12.213723 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-ndhqc" event={"ID":"9046c60e-6860-49b2-93d0-cfba9f569822","Type":"ContainerStarted","Data":"8bff349eae02ad37a33a2419519217ced43bbcdf170aab4ace4a2de059048f8c"} Jul 21 14:23:12.215998 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:12.215970 2576 generic.go:356] "Generic (PLEG): container finished" podID="6f7a8d43-ddf4-4e0d-94df-658673265924" containerID="1c5426e361f3de23f84c211d65e7bcd31825c80cb627d5264e5a0a2f8ee37e22" exitCode=0 Jul 21 14:23:12.216162 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:12.216014 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxbrgt" event={"ID":"6f7a8d43-ddf4-4e0d-94df-658673265924","Type":"ContainerDied","Data":"1c5426e361f3de23f84c211d65e7bcd31825c80cb627d5264e5a0a2f8ee37e22"} Jul 21 14:23:13.224966 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:13.224899 2576 generic.go:356] "Generic (PLEG): container finished" podID="6f7a8d43-ddf4-4e0d-94df-658673265924" containerID="ec985d6256227853cdaa8ea51f2de30deb50503447d476d0af5c71ada10114dc" exitCode=0 Jul 21 14:23:13.225635 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:13.224999 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxbrgt" event={"ID":"6f7a8d43-ddf4-4e0d-94df-658673265924","Type":"ContainerDied","Data":"ec985d6256227853cdaa8ea51f2de30deb50503447d476d0af5c71ada10114dc"} Jul 21 14:23:14.234100 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:14.234034 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-xrssm" event={"ID":"5d7623e2-e997-43c3-b02b-33f73a330d9d","Type":"ContainerStarted","Data":"b62860318d8929d708493d308acafffe1e5166dd8efd76822c3173185ac86346"} Jul 21 14:23:14.234774 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:14.234141 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-xrssm" Jul 21 14:23:14.236643 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:14.236592 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-ndhqc" event={"ID":"9046c60e-6860-49b2-93d0-cfba9f569822","Type":"ContainerStarted","Data":"de2e9958c6ca39d914207391a653aa2b09e63045d92037f9d34a505fdd1dbe37"} Jul 21 14:23:14.257588 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:14.257498 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-xrssm" podStartSLOduration=1.841645394 podStartE2EDuration="5.257474793s" totalImagesPullingTime="3.415829399s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:23:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:23:14.255505932 +0000 UTC m=+321.273409507" watchObservedRunningTime="2026-07-21 14:23:14.257474793 +0000 UTC m=+321.275378366" Jul 21 14:23:14.277485 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:14.277306 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-ndhqc" podStartSLOduration=1.804918048 podStartE2EDuration="3.277268626s" totalImagesPullingTime="1.472350578s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:23:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:23:14.275852903 +0000 UTC m=+321.293756475" watchObservedRunningTime="2026-07-21 14:23:14.277268626 +0000 UTC m=+321.295172201" Jul 21 14:23:14.399114 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:14.399072 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxbrgt" Jul 21 14:23:14.480481 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:14.480435 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f7a8d43-ddf4-4e0d-94df-658673265924-bundle\") pod \"6f7a8d43-ddf4-4e0d-94df-658673265924\" (UID: \"6f7a8d43-ddf4-4e0d-94df-658673265924\") " Jul 21 14:23:14.480815 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:14.480535 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f7a8d43-ddf4-4e0d-94df-658673265924-util\") pod \"6f7a8d43-ddf4-4e0d-94df-658673265924\" (UID: \"6f7a8d43-ddf4-4e0d-94df-658673265924\") " Jul 21 14:23:14.480815 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:14.480567 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5gfmr\" (UniqueName: \"kubernetes.io/projected/6f7a8d43-ddf4-4e0d-94df-658673265924-kube-api-access-5gfmr\") pod \"6f7a8d43-ddf4-4e0d-94df-658673265924\" (UID: \"6f7a8d43-ddf4-4e0d-94df-658673265924\") " Jul 21 14:23:14.481136 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:14.481096 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f7a8d43-ddf4-4e0d-94df-658673265924-bundle" (OuterVolumeSpecName: "bundle") pod "6f7a8d43-ddf4-4e0d-94df-658673265924" (UID: "6f7a8d43-ddf4-4e0d-94df-658673265924"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:23:14.483454 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:14.483411 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f7a8d43-ddf4-4e0d-94df-658673265924-kube-api-access-5gfmr" (OuterVolumeSpecName: "kube-api-access-5gfmr") pod "6f7a8d43-ddf4-4e0d-94df-658673265924" (UID: "6f7a8d43-ddf4-4e0d-94df-658673265924"). InnerVolumeSpecName "kube-api-access-5gfmr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 14:23:14.510589 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:14.510542 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f7a8d43-ddf4-4e0d-94df-658673265924-util" (OuterVolumeSpecName: "util") pod "6f7a8d43-ddf4-4e0d-94df-658673265924" (UID: "6f7a8d43-ddf4-4e0d-94df-658673265924"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:23:14.581689 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:14.581615 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f7a8d43-ddf4-4e0d-94df-658673265924-util\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:23:14.581689 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:14.581675 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5gfmr\" (UniqueName: \"kubernetes.io/projected/6f7a8d43-ddf4-4e0d-94df-658673265924-kube-api-access-5gfmr\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:23:14.581689 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:14.581701 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f7a8d43-ddf4-4e0d-94df-658673265924-bundle\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:23:15.245146 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:15.245068 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxbrgt" event={"ID":"6f7a8d43-ddf4-4e0d-94df-658673265924","Type":"ContainerDied","Data":"271996d518e6df1b04c3de93625eaa8248c12a63b67d510cc108ff4c5924dbb8"} Jul 21 14:23:15.245847 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:15.245171 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="271996d518e6df1b04c3de93625eaa8248c12a63b67d510cc108ff4c5924dbb8" Jul 21 14:23:15.245847 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:15.245093 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxbrgt" Jul 21 14:23:20.248556 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:20.248503 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-xrssm" Jul 21 14:23:21.005654 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:21.005583 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tbs6k"] Jul 21 14:23:21.006121 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:21.006105 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f7a8d43-ddf4-4e0d-94df-658673265924" containerName="pull" Jul 21 14:23:21.006210 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:21.006124 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f7a8d43-ddf4-4e0d-94df-658673265924" containerName="pull" Jul 21 14:23:21.006210 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:21.006144 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f7a8d43-ddf4-4e0d-94df-658673265924" containerName="util" Jul 21 14:23:21.006210 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:21.006149 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f7a8d43-ddf4-4e0d-94df-658673265924" containerName="util" Jul 21 14:23:21.006210 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:21.006178 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f7a8d43-ddf4-4e0d-94df-658673265924" containerName="extract" Jul 21 14:23:21.006210 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:21.006184 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f7a8d43-ddf4-4e0d-94df-658673265924" containerName="extract" Jul 21 14:23:21.006351 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:21.006245 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f7a8d43-ddf4-4e0d-94df-658673265924" containerName="extract" Jul 21 14:23:21.010984 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:21.010950 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tbs6k" Jul 21 14:23:21.014022 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:21.013971 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-kkrn6\"" Jul 21 14:23:21.014288 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:21.013971 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 21 14:23:21.015067 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:21.015032 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 21 14:23:21.019616 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:21.019571 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tbs6k"] Jul 21 14:23:21.034290 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:21.034221 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/59024c9f-5454-436a-8f32-d32aeb5af19c-tmp\") pod \"openshift-lws-operator-fd8ccff4c-tbs6k\" (UID: \"59024c9f-5454-436a-8f32-d32aeb5af19c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tbs6k" Jul 21 14:23:21.034290 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:21.034289 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hrgc\" (UniqueName: \"kubernetes.io/projected/59024c9f-5454-436a-8f32-d32aeb5af19c-kube-api-access-6hrgc\") pod \"openshift-lws-operator-fd8ccff4c-tbs6k\" (UID: \"59024c9f-5454-436a-8f32-d32aeb5af19c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tbs6k" Jul 21 14:23:21.135571 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:21.135504 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/59024c9f-5454-436a-8f32-d32aeb5af19c-tmp\") pod \"openshift-lws-operator-fd8ccff4c-tbs6k\" (UID: \"59024c9f-5454-436a-8f32-d32aeb5af19c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tbs6k" Jul 21 14:23:21.135571 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:21.135561 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hrgc\" (UniqueName: \"kubernetes.io/projected/59024c9f-5454-436a-8f32-d32aeb5af19c-kube-api-access-6hrgc\") pod \"openshift-lws-operator-fd8ccff4c-tbs6k\" (UID: \"59024c9f-5454-436a-8f32-d32aeb5af19c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tbs6k" Jul 21 14:23:21.136010 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:21.135991 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/59024c9f-5454-436a-8f32-d32aeb5af19c-tmp\") pod \"openshift-lws-operator-fd8ccff4c-tbs6k\" (UID: \"59024c9f-5454-436a-8f32-d32aeb5af19c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tbs6k" Jul 21 14:23:21.145990 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:21.145945 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hrgc\" (UniqueName: \"kubernetes.io/projected/59024c9f-5454-436a-8f32-d32aeb5af19c-kube-api-access-6hrgc\") pod \"openshift-lws-operator-fd8ccff4c-tbs6k\" (UID: \"59024c9f-5454-436a-8f32-d32aeb5af19c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tbs6k" Jul 21 14:23:21.324717 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:21.324622 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tbs6k" Jul 21 14:23:21.485831 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:21.485791 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tbs6k"] Jul 21 14:23:21.489455 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:23:21.489415 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod59024c9f_5454_436a_8f32_d32aeb5af19c.slice/crio-0da999eb9170c0b01ac009a25c86ee84ab8971525c6cc6b86749b8376b0f5819 WatchSource:0}: Error finding container 0da999eb9170c0b01ac009a25c86ee84ab8971525c6cc6b86749b8376b0f5819: Status 404 returned error can't find the container with id 0da999eb9170c0b01ac009a25c86ee84ab8971525c6cc6b86749b8376b0f5819 Jul 21 14:23:22.280358 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:22.280307 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tbs6k" event={"ID":"59024c9f-5454-436a-8f32-d32aeb5af19c","Type":"ContainerStarted","Data":"0da999eb9170c0b01ac009a25c86ee84ab8971525c6cc6b86749b8376b0f5819"} Jul 21 14:23:24.292102 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:24.292062 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tbs6k" event={"ID":"59024c9f-5454-436a-8f32-d32aeb5af19c","Type":"ContainerStarted","Data":"1c7e63b38b33f995324e34fcfe00c280869898c7f65c69beb6f27afa79c900a0"} Jul 21 14:23:24.312612 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:24.312534 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tbs6k" podStartSLOduration=1.918680653 podStartE2EDuration="4.31251789s" totalImagesPullingTime="2.393837237s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:23:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:23:24.310820597 +0000 UTC m=+331.328724171" watchObservedRunningTime="2026-07-21 14:23:24.31251789 +0000 UTC m=+331.330421464" Jul 21 14:23:27.641354 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:27.641311 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9bgfk"] Jul 21 14:23:27.661836 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:27.661735 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9bgfk"] Jul 21 14:23:27.662161 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:27.661957 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9bgfk" Jul 21 14:23:27.665182 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:27.665133 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 21 14:23:27.665517 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:27.665264 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-nq7dz\"" Jul 21 14:23:27.665517 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:27.665273 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 21 14:23:27.704211 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:27.704156 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7763a964-a863-4c12-9542-98b84462e40f-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9bgfk\" (UID: \"7763a964-a863-4c12-9542-98b84462e40f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9bgfk" Jul 21 14:23:27.704515 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:27.704234 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxpst\" (UniqueName: \"kubernetes.io/projected/7763a964-a863-4c12-9542-98b84462e40f-kube-api-access-gxpst\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9bgfk\" (UID: \"7763a964-a863-4c12-9542-98b84462e40f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9bgfk" Jul 21 14:23:27.704515 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:27.704367 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7763a964-a863-4c12-9542-98b84462e40f-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9bgfk\" (UID: \"7763a964-a863-4c12-9542-98b84462e40f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9bgfk" Jul 21 14:23:27.805345 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:27.805284 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7763a964-a863-4c12-9542-98b84462e40f-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9bgfk\" (UID: \"7763a964-a863-4c12-9542-98b84462e40f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9bgfk" Jul 21 14:23:27.805589 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:27.805394 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7763a964-a863-4c12-9542-98b84462e40f-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9bgfk\" (UID: \"7763a964-a863-4c12-9542-98b84462e40f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9bgfk" Jul 21 14:23:27.805589 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:27.805441 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxpst\" (UniqueName: \"kubernetes.io/projected/7763a964-a863-4c12-9542-98b84462e40f-kube-api-access-gxpst\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9bgfk\" (UID: \"7763a964-a863-4c12-9542-98b84462e40f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9bgfk" Jul 21 14:23:27.805894 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:27.805869 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7763a964-a863-4c12-9542-98b84462e40f-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9bgfk\" (UID: \"7763a964-a863-4c12-9542-98b84462e40f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9bgfk" Jul 21 14:23:27.805937 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:27.805887 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7763a964-a863-4c12-9542-98b84462e40f-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9bgfk\" (UID: \"7763a964-a863-4c12-9542-98b84462e40f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9bgfk" Jul 21 14:23:27.816574 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:27.816525 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxpst\" (UniqueName: \"kubernetes.io/projected/7763a964-a863-4c12-9542-98b84462e40f-kube-api-access-gxpst\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9bgfk\" (UID: \"7763a964-a863-4c12-9542-98b84462e40f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9bgfk" Jul 21 14:23:27.977693 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:27.977599 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9bgfk" Jul 21 14:23:28.148667 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:28.148615 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9bgfk"] Jul 21 14:23:28.152550 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:23:28.152495 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7763a964_a863_4c12_9542_98b84462e40f.slice/crio-d280bfc81b170343d4b2b33f56ce0a7bdb91b83c059519ae852307b1485f920a WatchSource:0}: Error finding container d280bfc81b170343d4b2b33f56ce0a7bdb91b83c059519ae852307b1485f920a: Status 404 returned error can't find the container with id d280bfc81b170343d4b2b33f56ce0a7bdb91b83c059519ae852307b1485f920a Jul 21 14:23:28.315350 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:28.315298 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9bgfk" event={"ID":"7763a964-a863-4c12-9542-98b84462e40f","Type":"ContainerStarted","Data":"0f91cc204b34e934d8df7a22b1f1d41e79832100228cba512edcab29a48dcd2d"} Jul 21 14:23:28.315592 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:28.315373 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9bgfk" event={"ID":"7763a964-a863-4c12-9542-98b84462e40f","Type":"ContainerStarted","Data":"d280bfc81b170343d4b2b33f56ce0a7bdb91b83c059519ae852307b1485f920a"} Jul 21 14:23:29.322483 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:29.322418 2576 generic.go:356] "Generic (PLEG): container finished" podID="7763a964-a863-4c12-9542-98b84462e40f" containerID="0f91cc204b34e934d8df7a22b1f1d41e79832100228cba512edcab29a48dcd2d" exitCode=0 Jul 21 14:23:29.323151 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:29.322485 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9bgfk" event={"ID":"7763a964-a863-4c12-9542-98b84462e40f","Type":"ContainerDied","Data":"0f91cc204b34e934d8df7a22b1f1d41e79832100228cba512edcab29a48dcd2d"} Jul 21 14:23:31.337879 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:31.337819 2576 generic.go:356] "Generic (PLEG): container finished" podID="7763a964-a863-4c12-9542-98b84462e40f" containerID="6ec57f1ab3008b58e359b7ff7e9a92f01d32489b7e49acb7679172096fe096cf" exitCode=0 Jul 21 14:23:31.338456 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:31.337901 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9bgfk" event={"ID":"7763a964-a863-4c12-9542-98b84462e40f","Type":"ContainerDied","Data":"6ec57f1ab3008b58e359b7ff7e9a92f01d32489b7e49acb7679172096fe096cf"} Jul 21 14:23:32.345617 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:32.345578 2576 generic.go:356] "Generic (PLEG): container finished" podID="7763a964-a863-4c12-9542-98b84462e40f" containerID="2f13d1c40b708c313f8b9f3fc3a4b3cc7b1fde4ca758f74482a799c168861fd8" exitCode=0 Jul 21 14:23:32.346097 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:32.345623 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9bgfk" event={"ID":"7763a964-a863-4c12-9542-98b84462e40f","Type":"ContainerDied","Data":"2f13d1c40b708c313f8b9f3fc3a4b3cc7b1fde4ca758f74482a799c168861fd8"} Jul 21 14:23:33.497398 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:33.497358 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9bgfk" Jul 21 14:23:33.556835 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:33.556757 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7763a964-a863-4c12-9542-98b84462e40f-util\") pod \"7763a964-a863-4c12-9542-98b84462e40f\" (UID: \"7763a964-a863-4c12-9542-98b84462e40f\") " Jul 21 14:23:33.557099 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:33.556867 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gxpst\" (UniqueName: \"kubernetes.io/projected/7763a964-a863-4c12-9542-98b84462e40f-kube-api-access-gxpst\") pod \"7763a964-a863-4c12-9542-98b84462e40f\" (UID: \"7763a964-a863-4c12-9542-98b84462e40f\") " Jul 21 14:23:33.557099 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:33.556933 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7763a964-a863-4c12-9542-98b84462e40f-bundle\") pod \"7763a964-a863-4c12-9542-98b84462e40f\" (UID: \"7763a964-a863-4c12-9542-98b84462e40f\") " Jul 21 14:23:33.557826 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:33.557753 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7763a964-a863-4c12-9542-98b84462e40f-bundle" (OuterVolumeSpecName: "bundle") pod "7763a964-a863-4c12-9542-98b84462e40f" (UID: "7763a964-a863-4c12-9542-98b84462e40f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:23:33.559563 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:33.559520 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7763a964-a863-4c12-9542-98b84462e40f-kube-api-access-gxpst" (OuterVolumeSpecName: "kube-api-access-gxpst") pod "7763a964-a863-4c12-9542-98b84462e40f" (UID: "7763a964-a863-4c12-9542-98b84462e40f"). InnerVolumeSpecName "kube-api-access-gxpst". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 14:23:33.562561 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:33.562517 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7763a964-a863-4c12-9542-98b84462e40f-util" (OuterVolumeSpecName: "util") pod "7763a964-a863-4c12-9542-98b84462e40f" (UID: "7763a964-a863-4c12-9542-98b84462e40f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:23:33.658491 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:33.658316 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gxpst\" (UniqueName: \"kubernetes.io/projected/7763a964-a863-4c12-9542-98b84462e40f-kube-api-access-gxpst\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:23:33.658491 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:33.658371 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7763a964-a863-4c12-9542-98b84462e40f-bundle\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:23:33.658491 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:33.658389 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7763a964-a863-4c12-9542-98b84462e40f-util\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:23:34.358016 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:34.357982 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9bgfk" Jul 21 14:23:34.358016 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:34.358009 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9bgfk" event={"ID":"7763a964-a863-4c12-9542-98b84462e40f","Type":"ContainerDied","Data":"d280bfc81b170343d4b2b33f56ce0a7bdb91b83c059519ae852307b1485f920a"} Jul 21 14:23:34.358324 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:34.358068 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d280bfc81b170343d4b2b33f56ce0a7bdb91b83c059519ae852307b1485f920a" Jul 21 14:23:45.376852 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:45.376699 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6df87d547c-ljzmk"] Jul 21 14:23:45.377373 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:45.377301 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7763a964-a863-4c12-9542-98b84462e40f" containerName="util" Jul 21 14:23:45.377373 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:45.377325 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7763a964-a863-4c12-9542-98b84462e40f" containerName="util" Jul 21 14:23:45.377373 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:45.377351 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7763a964-a863-4c12-9542-98b84462e40f" containerName="pull" Jul 21 14:23:45.377373 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:45.377356 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7763a964-a863-4c12-9542-98b84462e40f" containerName="pull" Jul 21 14:23:45.377373 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:45.377364 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7763a964-a863-4c12-9542-98b84462e40f" containerName="extract" Jul 21 14:23:45.377373 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:45.377370 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7763a964-a863-4c12-9542-98b84462e40f" containerName="extract" Jul 21 14:23:45.377602 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:45.377428 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7763a964-a863-4c12-9542-98b84462e40f" containerName="extract" Jul 21 14:23:45.380230 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:45.380186 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6df87d547c-ljzmk" Jul 21 14:23:45.384304 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:45.384265 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 21 14:23:45.384497 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:45.384331 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 21 14:23:45.384497 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:45.384331 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 21 14:23:45.384497 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:45.384369 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-nxv49\"" Jul 21 14:23:45.392572 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:45.392541 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6df87d547c-ljzmk"] Jul 21 14:23:45.473267 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:45.473192 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2c2c6c31-dd66-4948-b1bb-40c66731ef68-cert\") pod \"lws-controller-manager-6df87d547c-ljzmk\" (UID: \"2c2c6c31-dd66-4948-b1bb-40c66731ef68\") " pod="openshift-lws-operator/lws-controller-manager-6df87d547c-ljzmk" Jul 21 14:23:45.473662 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:45.473282 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2c2c6c31-dd66-4948-b1bb-40c66731ef68-manager-config\") pod \"lws-controller-manager-6df87d547c-ljzmk\" (UID: \"2c2c6c31-dd66-4948-b1bb-40c66731ef68\") " pod="openshift-lws-operator/lws-controller-manager-6df87d547c-ljzmk" Jul 21 14:23:45.473662 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:45.473330 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2c2c6c31-dd66-4948-b1bb-40c66731ef68-metrics-cert\") pod \"lws-controller-manager-6df87d547c-ljzmk\" (UID: \"2c2c6c31-dd66-4948-b1bb-40c66731ef68\") " pod="openshift-lws-operator/lws-controller-manager-6df87d547c-ljzmk" Jul 21 14:23:45.473662 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:45.473367 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bn44c\" (UniqueName: \"kubernetes.io/projected/2c2c6c31-dd66-4948-b1bb-40c66731ef68-kube-api-access-bn44c\") pod \"lws-controller-manager-6df87d547c-ljzmk\" (UID: \"2c2c6c31-dd66-4948-b1bb-40c66731ef68\") " pod="openshift-lws-operator/lws-controller-manager-6df87d547c-ljzmk" Jul 21 14:23:45.574538 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:45.574496 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2c2c6c31-dd66-4948-b1bb-40c66731ef68-cert\") pod \"lws-controller-manager-6df87d547c-ljzmk\" (UID: \"2c2c6c31-dd66-4948-b1bb-40c66731ef68\") " pod="openshift-lws-operator/lws-controller-manager-6df87d547c-ljzmk" Jul 21 14:23:45.574538 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:45.574560 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2c2c6c31-dd66-4948-b1bb-40c66731ef68-manager-config\") pod \"lws-controller-manager-6df87d547c-ljzmk\" (UID: \"2c2c6c31-dd66-4948-b1bb-40c66731ef68\") " pod="openshift-lws-operator/lws-controller-manager-6df87d547c-ljzmk" Jul 21 14:23:45.575021 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:45.574596 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2c2c6c31-dd66-4948-b1bb-40c66731ef68-metrics-cert\") pod \"lws-controller-manager-6df87d547c-ljzmk\" (UID: \"2c2c6c31-dd66-4948-b1bb-40c66731ef68\") " pod="openshift-lws-operator/lws-controller-manager-6df87d547c-ljzmk" Jul 21 14:23:45.575021 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:45.574624 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bn44c\" (UniqueName: \"kubernetes.io/projected/2c2c6c31-dd66-4948-b1bb-40c66731ef68-kube-api-access-bn44c\") pod \"lws-controller-manager-6df87d547c-ljzmk\" (UID: \"2c2c6c31-dd66-4948-b1bb-40c66731ef68\") " pod="openshift-lws-operator/lws-controller-manager-6df87d547c-ljzmk" Jul 21 14:23:45.575454 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:45.575422 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2c2c6c31-dd66-4948-b1bb-40c66731ef68-manager-config\") pod \"lws-controller-manager-6df87d547c-ljzmk\" (UID: \"2c2c6c31-dd66-4948-b1bb-40c66731ef68\") " pod="openshift-lws-operator/lws-controller-manager-6df87d547c-ljzmk" Jul 21 14:23:45.577565 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:45.577526 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2c2c6c31-dd66-4948-b1bb-40c66731ef68-metrics-cert\") pod \"lws-controller-manager-6df87d547c-ljzmk\" (UID: \"2c2c6c31-dd66-4948-b1bb-40c66731ef68\") " pod="openshift-lws-operator/lws-controller-manager-6df87d547c-ljzmk" Jul 21 14:23:45.577711 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:45.577540 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2c2c6c31-dd66-4948-b1bb-40c66731ef68-cert\") pod \"lws-controller-manager-6df87d547c-ljzmk\" (UID: \"2c2c6c31-dd66-4948-b1bb-40c66731ef68\") " pod="openshift-lws-operator/lws-controller-manager-6df87d547c-ljzmk" Jul 21 14:23:45.585461 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:45.585432 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bn44c\" (UniqueName: \"kubernetes.io/projected/2c2c6c31-dd66-4948-b1bb-40c66731ef68-kube-api-access-bn44c\") pod \"lws-controller-manager-6df87d547c-ljzmk\" (UID: \"2c2c6c31-dd66-4948-b1bb-40c66731ef68\") " pod="openshift-lws-operator/lws-controller-manager-6df87d547c-ljzmk" Jul 21 14:23:45.693446 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:45.693357 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6df87d547c-ljzmk" Jul 21 14:23:45.888088 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:45.888020 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6df87d547c-ljzmk"] Jul 21 14:23:45.890732 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:23:45.890679 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c2c6c31_dd66_4948_b1bb_40c66731ef68.slice/crio-0eadab6437a2b2de649205a63c86c37251b450593ab72a058bd0073a14c64692 WatchSource:0}: Error finding container 0eadab6437a2b2de649205a63c86c37251b450593ab72a058bd0073a14c64692: Status 404 returned error can't find the container with id 0eadab6437a2b2de649205a63c86c37251b450593ab72a058bd0073a14c64692 Jul 21 14:23:45.897686 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:45.897654 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86bb54d755-z9zzf"] Jul 21 14:23:45.901123 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:45.901096 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-86bb54d755-z9zzf" Jul 21 14:23:45.905157 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:45.905041 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 21 14:23:45.905157 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:45.905058 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-n8qqh\"" Jul 21 14:23:45.905436 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:45.905171 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 21 14:23:45.905436 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:45.905399 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 21 14:23:45.905584 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:45.905565 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 21 14:23:45.923495 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:45.923464 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86bb54d755-z9zzf"] Jul 21 14:23:45.978553 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:45.978428 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/10f02733-b938-4db1-8386-94663104c507-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86bb54d755-z9zzf\" (UID: \"10f02733-b938-4db1-8386-94663104c507\") " pod="opendatahub/opendatahub-operator-controller-manager-86bb54d755-z9zzf" Jul 21 14:23:45.978553 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:45.978488 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/10f02733-b938-4db1-8386-94663104c507-manifests\") pod \"opendatahub-operator-controller-manager-86bb54d755-z9zzf\" (UID: \"10f02733-b938-4db1-8386-94663104c507\") " pod="opendatahub/opendatahub-operator-controller-manager-86bb54d755-z9zzf" Jul 21 14:23:45.978553 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:45.978544 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wz2js\" (UniqueName: \"kubernetes.io/projected/10f02733-b938-4db1-8386-94663104c507-kube-api-access-wz2js\") pod \"opendatahub-operator-controller-manager-86bb54d755-z9zzf\" (UID: \"10f02733-b938-4db1-8386-94663104c507\") " pod="opendatahub/opendatahub-operator-controller-manager-86bb54d755-z9zzf" Jul 21 14:23:45.978899 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:45.978620 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/10f02733-b938-4db1-8386-94663104c507-tmp\") pod \"opendatahub-operator-controller-manager-86bb54d755-z9zzf\" (UID: \"10f02733-b938-4db1-8386-94663104c507\") " pod="opendatahub/opendatahub-operator-controller-manager-86bb54d755-z9zzf" Jul 21 14:23:45.978899 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:45.978661 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/10f02733-b938-4db1-8386-94663104c507-webhook-cert\") pod \"opendatahub-operator-controller-manager-86bb54d755-z9zzf\" (UID: \"10f02733-b938-4db1-8386-94663104c507\") " pod="opendatahub/opendatahub-operator-controller-manager-86bb54d755-z9zzf" Jul 21 14:23:46.080185 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:46.080110 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/10f02733-b938-4db1-8386-94663104c507-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86bb54d755-z9zzf\" (UID: \"10f02733-b938-4db1-8386-94663104c507\") " pod="opendatahub/opendatahub-operator-controller-manager-86bb54d755-z9zzf" Jul 21 14:23:46.080185 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:46.080200 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/10f02733-b938-4db1-8386-94663104c507-manifests\") pod \"opendatahub-operator-controller-manager-86bb54d755-z9zzf\" (UID: \"10f02733-b938-4db1-8386-94663104c507\") " pod="opendatahub/opendatahub-operator-controller-manager-86bb54d755-z9zzf" Jul 21 14:23:46.080557 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:46.080231 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wz2js\" (UniqueName: \"kubernetes.io/projected/10f02733-b938-4db1-8386-94663104c507-kube-api-access-wz2js\") pod \"opendatahub-operator-controller-manager-86bb54d755-z9zzf\" (UID: \"10f02733-b938-4db1-8386-94663104c507\") " pod="opendatahub/opendatahub-operator-controller-manager-86bb54d755-z9zzf" Jul 21 14:23:46.080557 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:46.080263 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/10f02733-b938-4db1-8386-94663104c507-tmp\") pod \"opendatahub-operator-controller-manager-86bb54d755-z9zzf\" (UID: \"10f02733-b938-4db1-8386-94663104c507\") " pod="opendatahub/opendatahub-operator-controller-manager-86bb54d755-z9zzf" Jul 21 14:23:46.080557 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:46.080312 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/10f02733-b938-4db1-8386-94663104c507-webhook-cert\") pod \"opendatahub-operator-controller-manager-86bb54d755-z9zzf\" (UID: \"10f02733-b938-4db1-8386-94663104c507\") " pod="opendatahub/opendatahub-operator-controller-manager-86bb54d755-z9zzf" Jul 21 14:23:46.080973 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:46.080930 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/10f02733-b938-4db1-8386-94663104c507-manifests\") pod \"opendatahub-operator-controller-manager-86bb54d755-z9zzf\" (UID: \"10f02733-b938-4db1-8386-94663104c507\") " pod="opendatahub/opendatahub-operator-controller-manager-86bb54d755-z9zzf" Jul 21 14:23:46.083520 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:46.083466 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/10f02733-b938-4db1-8386-94663104c507-tmp\") pod \"opendatahub-operator-controller-manager-86bb54d755-z9zzf\" (UID: \"10f02733-b938-4db1-8386-94663104c507\") " pod="opendatahub/opendatahub-operator-controller-manager-86bb54d755-z9zzf" Jul 21 14:23:46.083770 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:46.083693 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/10f02733-b938-4db1-8386-94663104c507-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86bb54d755-z9zzf\" (UID: \"10f02733-b938-4db1-8386-94663104c507\") " pod="opendatahub/opendatahub-operator-controller-manager-86bb54d755-z9zzf" Jul 21 14:23:46.083870 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:46.083808 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/10f02733-b938-4db1-8386-94663104c507-webhook-cert\") pod \"opendatahub-operator-controller-manager-86bb54d755-z9zzf\" (UID: \"10f02733-b938-4db1-8386-94663104c507\") " pod="opendatahub/opendatahub-operator-controller-manager-86bb54d755-z9zzf" Jul 21 14:23:46.094522 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:46.094482 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wz2js\" (UniqueName: \"kubernetes.io/projected/10f02733-b938-4db1-8386-94663104c507-kube-api-access-wz2js\") pod \"opendatahub-operator-controller-manager-86bb54d755-z9zzf\" (UID: \"10f02733-b938-4db1-8386-94663104c507\") " pod="opendatahub/opendatahub-operator-controller-manager-86bb54d755-z9zzf" Jul 21 14:23:46.215006 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:46.214943 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-86bb54d755-z9zzf" Jul 21 14:23:46.407294 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:46.407260 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86bb54d755-z9zzf"] Jul 21 14:23:46.411517 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:23:46.411469 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10f02733_b938_4db1_8386_94663104c507.slice/crio-1e646c9ea99980e7124b26266b05de12144b95b1a016c385897b52fea83b54c4 WatchSource:0}: Error finding container 1e646c9ea99980e7124b26266b05de12144b95b1a016c385897b52fea83b54c4: Status 404 returned error can't find the container with id 1e646c9ea99980e7124b26266b05de12144b95b1a016c385897b52fea83b54c4 Jul 21 14:23:46.447361 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:46.445631 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6df87d547c-ljzmk" event={"ID":"2c2c6c31-dd66-4948-b1bb-40c66731ef68","Type":"ContainerStarted","Data":"0eadab6437a2b2de649205a63c86c37251b450593ab72a058bd0073a14c64692"} Jul 21 14:23:46.449146 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:46.448215 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86bb54d755-z9zzf" event={"ID":"10f02733-b938-4db1-8386-94663104c507","Type":"ContainerStarted","Data":"1e646c9ea99980e7124b26266b05de12144b95b1a016c385897b52fea83b54c4"} Jul 21 14:23:47.458658 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:47.458594 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6df87d547c-ljzmk" event={"ID":"2c2c6c31-dd66-4948-b1bb-40c66731ef68","Type":"ContainerStarted","Data":"ed5e45890d791c4e85991c5c739a22a2dfb06819d7ec3866a9ee26b603a11b55"} Jul 21 14:23:47.459321 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:47.458891 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6df87d547c-ljzmk" Jul 21 14:23:47.480965 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:47.480834 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6df87d547c-ljzmk" podStartSLOduration=1.055288668 podStartE2EDuration="2.480772299s" totalImagesPullingTime="1.425483631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:23:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:23:47.478630188 +0000 UTC m=+354.496533764" watchObservedRunningTime="2026-07-21 14:23:47.480772299 +0000 UTC m=+354.498675952" Jul 21 14:23:50.478234 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:50.478197 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86bb54d755-z9zzf" event={"ID":"10f02733-b938-4db1-8386-94663104c507","Type":"ContainerStarted","Data":"fad4c09e3c447849f136246e7fc32db2b2a2e9841b38f99aeafd068a77504639"} Jul 21 14:23:51.485707 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:51.485621 2576 generic.go:356] "Generic (PLEG): container finished" podID="10f02733-b938-4db1-8386-94663104c507" containerID="fad4c09e3c447849f136246e7fc32db2b2a2e9841b38f99aeafd068a77504639" exitCode=0 Jul 21 14:23:51.485707 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:51.485675 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86bb54d755-z9zzf" event={"ID":"10f02733-b938-4db1-8386-94663104c507","Type":"ContainerDied","Data":"fad4c09e3c447849f136246e7fc32db2b2a2e9841b38f99aeafd068a77504639"} Jul 21 14:23:53.497546 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:53.497510 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86bb54d755-z9zzf" event={"ID":"10f02733-b938-4db1-8386-94663104c507","Type":"ContainerStarted","Data":"6bc2e5742a8b6f7591642664d931c56b8ab50bdd9dd71b4a20e54912b651506b"} Jul 21 14:23:53.497976 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:53.497617 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-86bb54d755-z9zzf" Jul 21 14:23:53.523640 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:53.523573 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-86bb54d755-z9zzf" podStartSLOduration=2.587790924 podStartE2EDuration="8.523550486s" totalImagesPullingTime="4.667650027s" totalInitContainerRuntime="1.268109535s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:23:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:23:53.521361312 +0000 UTC m=+360.539264887" watchObservedRunningTime="2026-07-21 14:23:53.523550486 +0000 UTC m=+360.541454060" Jul 21 14:23:58.469266 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:23:58.469232 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6df87d547c-ljzmk" Jul 21 14:24:04.506214 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:04.506184 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-86bb54d755-z9zzf" Jul 21 14:24:14.677107 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:14.677048 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678cdcdg"] Jul 21 14:24:14.685638 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:14.685581 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678cdcdg" Jul 21 14:24:14.688759 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:14.688726 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 21 14:24:14.688977 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:14.688941 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 21 14:24:14.688977 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:14.688955 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-8kjhz\"" Jul 21 14:24:14.689077 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:14.688988 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 21 14:24:14.695128 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:14.695085 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678cdcdg"] Jul 21 14:24:14.751235 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:14.751182 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb4e3f6d-7578-4166-87ff-51c04339867a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678cdcdg\" (UID: \"cb4e3f6d-7578-4166-87ff-51c04339867a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678cdcdg" Jul 21 14:24:14.751470 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:14.751266 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb4e3f6d-7578-4166-87ff-51c04339867a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678cdcdg\" (UID: \"cb4e3f6d-7578-4166-87ff-51c04339867a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678cdcdg" Jul 21 14:24:14.751470 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:14.751296 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb4e3f6d-7578-4166-87ff-51c04339867a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678cdcdg\" (UID: \"cb4e3f6d-7578-4166-87ff-51c04339867a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678cdcdg" Jul 21 14:24:14.751470 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:14.751315 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb4e3f6d-7578-4166-87ff-51c04339867a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678cdcdg\" (UID: \"cb4e3f6d-7578-4166-87ff-51c04339867a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678cdcdg" Jul 21 14:24:14.751470 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:14.751334 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb4e3f6d-7578-4166-87ff-51c04339867a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678cdcdg\" (UID: \"cb4e3f6d-7578-4166-87ff-51c04339867a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678cdcdg" Jul 21 14:24:14.751470 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:14.751389 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb4e3f6d-7578-4166-87ff-51c04339867a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678cdcdg\" (UID: \"cb4e3f6d-7578-4166-87ff-51c04339867a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678cdcdg" Jul 21 14:24:14.751470 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:14.751440 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb4e3f6d-7578-4166-87ff-51c04339867a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678cdcdg\" (UID: \"cb4e3f6d-7578-4166-87ff-51c04339867a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678cdcdg" Jul 21 14:24:14.751470 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:14.751467 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5vwz\" (UniqueName: \"kubernetes.io/projected/cb4e3f6d-7578-4166-87ff-51c04339867a-kube-api-access-b5vwz\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678cdcdg\" (UID: \"cb4e3f6d-7578-4166-87ff-51c04339867a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678cdcdg" Jul 21 14:24:14.751720 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:14.751486 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb4e3f6d-7578-4166-87ff-51c04339867a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678cdcdg\" (UID: \"cb4e3f6d-7578-4166-87ff-51c04339867a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678cdcdg" Jul 21 14:24:14.852972 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:14.852910 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb4e3f6d-7578-4166-87ff-51c04339867a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678cdcdg\" (UID: \"cb4e3f6d-7578-4166-87ff-51c04339867a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678cdcdg" Jul 21 14:24:14.852972 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:14.852979 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb4e3f6d-7578-4166-87ff-51c04339867a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678cdcdg\" (UID: \"cb4e3f6d-7578-4166-87ff-51c04339867a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678cdcdg" Jul 21 14:24:14.853439 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:14.852999 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb4e3f6d-7578-4166-87ff-51c04339867a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678cdcdg\" (UID: \"cb4e3f6d-7578-4166-87ff-51c04339867a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678cdcdg" Jul 21 14:24:14.853439 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:14.853022 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb4e3f6d-7578-4166-87ff-51c04339867a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678cdcdg\" (UID: \"cb4e3f6d-7578-4166-87ff-51c04339867a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678cdcdg" Jul 21 14:24:14.853439 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:14.853045 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb4e3f6d-7578-4166-87ff-51c04339867a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678cdcdg\" (UID: \"cb4e3f6d-7578-4166-87ff-51c04339867a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678cdcdg" Jul 21 14:24:14.853439 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:14.853081 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb4e3f6d-7578-4166-87ff-51c04339867a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678cdcdg\" (UID: \"cb4e3f6d-7578-4166-87ff-51c04339867a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678cdcdg" Jul 21 14:24:14.853439 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:14.853120 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5vwz\" (UniqueName: \"kubernetes.io/projected/cb4e3f6d-7578-4166-87ff-51c04339867a-kube-api-access-b5vwz\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678cdcdg\" (UID: \"cb4e3f6d-7578-4166-87ff-51c04339867a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678cdcdg" Jul 21 14:24:14.853439 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:14.853155 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb4e3f6d-7578-4166-87ff-51c04339867a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678cdcdg\" (UID: \"cb4e3f6d-7578-4166-87ff-51c04339867a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678cdcdg" Jul 21 14:24:14.853439 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:14.853205 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb4e3f6d-7578-4166-87ff-51c04339867a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678cdcdg\" (UID: \"cb4e3f6d-7578-4166-87ff-51c04339867a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678cdcdg" Jul 21 14:24:14.853775 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:14.853524 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb4e3f6d-7578-4166-87ff-51c04339867a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678cdcdg\" (UID: \"cb4e3f6d-7578-4166-87ff-51c04339867a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678cdcdg" Jul 21 14:24:14.853775 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:14.853556 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb4e3f6d-7578-4166-87ff-51c04339867a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678cdcdg\" (UID: \"cb4e3f6d-7578-4166-87ff-51c04339867a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678cdcdg" Jul 21 14:24:14.853775 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:14.853653 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb4e3f6d-7578-4166-87ff-51c04339867a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678cdcdg\" (UID: \"cb4e3f6d-7578-4166-87ff-51c04339867a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678cdcdg" Jul 21 14:24:14.853946 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:14.853824 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb4e3f6d-7578-4166-87ff-51c04339867a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678cdcdg\" (UID: \"cb4e3f6d-7578-4166-87ff-51c04339867a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678cdcdg" Jul 21 14:24:14.854186 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:14.854159 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb4e3f6d-7578-4166-87ff-51c04339867a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678cdcdg\" (UID: \"cb4e3f6d-7578-4166-87ff-51c04339867a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678cdcdg" Jul 21 14:24:14.856357 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:14.856290 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb4e3f6d-7578-4166-87ff-51c04339867a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678cdcdg\" (UID: \"cb4e3f6d-7578-4166-87ff-51c04339867a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678cdcdg" Jul 21 14:24:14.856525 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:14.856510 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb4e3f6d-7578-4166-87ff-51c04339867a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678cdcdg\" (UID: \"cb4e3f6d-7578-4166-87ff-51c04339867a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678cdcdg" Jul 21 14:24:14.865186 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:14.865147 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb4e3f6d-7578-4166-87ff-51c04339867a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678cdcdg\" (UID: \"cb4e3f6d-7578-4166-87ff-51c04339867a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678cdcdg" Jul 21 14:24:14.865819 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:14.865761 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5vwz\" (UniqueName: \"kubernetes.io/projected/cb4e3f6d-7578-4166-87ff-51c04339867a-kube-api-access-b5vwz\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678cdcdg\" (UID: \"cb4e3f6d-7578-4166-87ff-51c04339867a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678cdcdg" Jul 21 14:24:15.001922 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:15.001865 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678cdcdg" Jul 21 14:24:15.170509 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:15.170486 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678cdcdg"] Jul 21 14:24:15.172290 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:24:15.172259 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb4e3f6d_7578_4166_87ff_51c04339867a.slice/crio-48c6ccc358562f7b1cb20860215162faabcad5b293c73e0d497120e1c3036324 WatchSource:0}: Error finding container 48c6ccc358562f7b1cb20860215162faabcad5b293c73e0d497120e1c3036324: Status 404 returned error can't find the container with id 48c6ccc358562f7b1cb20860215162faabcad5b293c73e0d497120e1c3036324 Jul 21 14:24:15.623835 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:15.623716 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678cdcdg" event={"ID":"cb4e3f6d-7578-4166-87ff-51c04339867a","Type":"ContainerStarted","Data":"48c6ccc358562f7b1cb20860215162faabcad5b293c73e0d497120e1c3036324"} Jul 21 14:24:16.961132 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:16.961102 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jm9rj"] Jul 21 14:24:16.964858 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:16.964822 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jm9rj" Jul 21 14:24:16.973728 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:16.973697 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 21 14:24:16.973994 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:16.973698 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 21 14:24:16.974209 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:16.974188 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 21 14:24:16.978981 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:16.978951 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-dxlr4\"" Jul 21 14:24:16.997004 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:16.996960 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jm9rj"] Jul 21 14:24:17.077470 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:17.077421 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5b7d62a9-f7e6-4896-860d-57b6fd3ff726-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-jm9rj\" (UID: \"5b7d62a9-f7e6-4896-860d-57b6fd3ff726\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jm9rj" Jul 21 14:24:17.077707 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:17.077543 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5b7d62a9-f7e6-4896-860d-57b6fd3ff726-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-jm9rj\" (UID: \"5b7d62a9-f7e6-4896-860d-57b6fd3ff726\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jm9rj" Jul 21 14:24:17.077707 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:17.077620 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5b7d62a9-f7e6-4896-860d-57b6fd3ff726-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-jm9rj\" (UID: \"5b7d62a9-f7e6-4896-860d-57b6fd3ff726\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jm9rj" Jul 21 14:24:17.077843 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:17.077708 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b7d62a9-f7e6-4896-860d-57b6fd3ff726-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-jm9rj\" (UID: \"5b7d62a9-f7e6-4896-860d-57b6fd3ff726\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jm9rj" Jul 21 14:24:17.077843 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:17.077733 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b7d62a9-f7e6-4896-860d-57b6fd3ff726-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-jm9rj\" (UID: \"5b7d62a9-f7e6-4896-860d-57b6fd3ff726\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jm9rj" Jul 21 14:24:17.077843 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:17.077766 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sn9l\" (UniqueName: \"kubernetes.io/projected/5b7d62a9-f7e6-4896-860d-57b6fd3ff726-kube-api-access-4sn9l\") pod \"istiod-openshift-gateway-94bb8fbfd-jm9rj\" (UID: \"5b7d62a9-f7e6-4896-860d-57b6fd3ff726\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jm9rj" Jul 21 14:24:17.077998 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:17.077887 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5b7d62a9-f7e6-4896-860d-57b6fd3ff726-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-jm9rj\" (UID: \"5b7d62a9-f7e6-4896-860d-57b6fd3ff726\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jm9rj" Jul 21 14:24:17.179330 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:17.179269 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5b7d62a9-f7e6-4896-860d-57b6fd3ff726-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-jm9rj\" (UID: \"5b7d62a9-f7e6-4896-860d-57b6fd3ff726\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jm9rj" Jul 21 14:24:17.179575 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:17.179344 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5b7d62a9-f7e6-4896-860d-57b6fd3ff726-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-jm9rj\" (UID: \"5b7d62a9-f7e6-4896-860d-57b6fd3ff726\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jm9rj" Jul 21 14:24:17.179575 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:17.179421 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b7d62a9-f7e6-4896-860d-57b6fd3ff726-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-jm9rj\" (UID: \"5b7d62a9-f7e6-4896-860d-57b6fd3ff726\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jm9rj" Jul 21 14:24:17.179575 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:17.179450 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b7d62a9-f7e6-4896-860d-57b6fd3ff726-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-jm9rj\" (UID: \"5b7d62a9-f7e6-4896-860d-57b6fd3ff726\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jm9rj" Jul 21 14:24:17.179575 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:17.179485 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4sn9l\" (UniqueName: \"kubernetes.io/projected/5b7d62a9-f7e6-4896-860d-57b6fd3ff726-kube-api-access-4sn9l\") pod \"istiod-openshift-gateway-94bb8fbfd-jm9rj\" (UID: \"5b7d62a9-f7e6-4896-860d-57b6fd3ff726\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jm9rj" Jul 21 14:24:17.179575 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:17.179558 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5b7d62a9-f7e6-4896-860d-57b6fd3ff726-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-jm9rj\" (UID: \"5b7d62a9-f7e6-4896-860d-57b6fd3ff726\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jm9rj" Jul 21 14:24:17.179903 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:17.179593 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5b7d62a9-f7e6-4896-860d-57b6fd3ff726-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-jm9rj\" (UID: \"5b7d62a9-f7e6-4896-860d-57b6fd3ff726\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jm9rj" Jul 21 14:24:17.180653 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:17.180587 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5b7d62a9-f7e6-4896-860d-57b6fd3ff726-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-jm9rj\" (UID: \"5b7d62a9-f7e6-4896-860d-57b6fd3ff726\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jm9rj" Jul 21 14:24:17.183216 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:17.183172 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b7d62a9-f7e6-4896-860d-57b6fd3ff726-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-jm9rj\" (UID: \"5b7d62a9-f7e6-4896-860d-57b6fd3ff726\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jm9rj" Jul 21 14:24:17.183438 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:17.183229 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5b7d62a9-f7e6-4896-860d-57b6fd3ff726-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-jm9rj\" (UID: \"5b7d62a9-f7e6-4896-860d-57b6fd3ff726\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jm9rj" Jul 21 14:24:17.183438 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:17.183235 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5b7d62a9-f7e6-4896-860d-57b6fd3ff726-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-jm9rj\" (UID: \"5b7d62a9-f7e6-4896-860d-57b6fd3ff726\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jm9rj" Jul 21 14:24:17.183570 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:17.183530 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5b7d62a9-f7e6-4896-860d-57b6fd3ff726-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-jm9rj\" (UID: \"5b7d62a9-f7e6-4896-860d-57b6fd3ff726\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jm9rj" Jul 21 14:24:17.195743 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:17.195666 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sn9l\" (UniqueName: \"kubernetes.io/projected/5b7d62a9-f7e6-4896-860d-57b6fd3ff726-kube-api-access-4sn9l\") pod \"istiod-openshift-gateway-94bb8fbfd-jm9rj\" (UID: \"5b7d62a9-f7e6-4896-860d-57b6fd3ff726\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jm9rj" Jul 21 14:24:17.204066 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:17.203967 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b7d62a9-f7e6-4896-860d-57b6fd3ff726-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-jm9rj\" (UID: \"5b7d62a9-f7e6-4896-860d-57b6fd3ff726\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jm9rj" Jul 21 14:24:17.279613 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:17.279575 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jm9rj" Jul 21 14:24:18.076289 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:18.076242 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:24:18.076655 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:18.076354 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:24:18.076655 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:18.076407 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:24:18.175291 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:18.175260 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jm9rj"] Jul 21 14:24:18.176631 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:24:18.176599 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b7d62a9_f7e6_4896_860d_57b6fd3ff726.slice/crio-4e6daec15193840efe90ce7ed0d4806143f531b680b309342266ce20693e54c4 WatchSource:0}: Error finding container 4e6daec15193840efe90ce7ed0d4806143f531b680b309342266ce20693e54c4: Status 404 returned error can't find the container with id 4e6daec15193840efe90ce7ed0d4806143f531b680b309342266ce20693e54c4 Jul 21 14:24:18.646010 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:18.645956 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jm9rj" event={"ID":"5b7d62a9-f7e6-4896-860d-57b6fd3ff726","Type":"ContainerStarted","Data":"4e6daec15193840efe90ce7ed0d4806143f531b680b309342266ce20693e54c4"} Jul 21 14:24:18.647517 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:18.647492 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678cdcdg" event={"ID":"cb4e3f6d-7578-4166-87ff-51c04339867a","Type":"ContainerStarted","Data":"8954e5b880490153be475e4c2d6fe851082ca13deebad32e63a1967da691e112"} Jul 21 14:24:18.671491 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:18.671438 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678cdcdg" podStartSLOduration=1.769923721 podStartE2EDuration="4.671407876s" totalImagesPullingTime="2.901484155s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:24:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:24:18.670221507 +0000 UTC m=+385.688125082" watchObservedRunningTime="2026-07-21 14:24:18.671407876 +0000 UTC m=+385.689311451" Jul 21 14:24:19.002596 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:19.002522 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678cdcdg" Jul 21 14:24:19.012203 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:19.012139 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678cdcdg" Jul 21 14:24:19.654835 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:19.654773 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678cdcdg" Jul 21 14:24:19.656191 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:19.656159 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678cdcdg" Jul 21 14:24:20.754931 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:20.754889 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:24:20.755306 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:20.754965 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:24:21.667252 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:21.667203 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jm9rj" event={"ID":"5b7d62a9-f7e6-4896-860d-57b6fd3ff726","Type":"ContainerStarted","Data":"e11937bb67bf5a4bd6bae5ee6fbcc3140db250ecb4e557d937c12d50cfd69600"} Jul 21 14:24:21.667504 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:21.667448 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jm9rj" Jul 21 14:24:21.669646 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:21.669596 2576 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-jm9rj container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 21 14:24:21.669861 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:21.669676 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jm9rj" podUID="5b7d62a9-f7e6-4896-860d-57b6fd3ff726" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 21 14:24:21.692975 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:21.692911 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jm9rj" podStartSLOduration=3.117628486 podStartE2EDuration="5.692892186s" totalImagesPullingTime="2.5752637s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:24:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:24:21.691037688 +0000 UTC m=+388.708941286" watchObservedRunningTime="2026-07-21 14:24:21.692892186 +0000 UTC m=+388.710795760" Jul 21 14:24:22.673575 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:22.673541 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jm9rj" Jul 21 14:24:53.393918 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:24:53.393860 2576 scope.go:117] "RemoveContainer" containerID="772acdbf48fae081e1f831313cd2069df0e52bf81bb32a4c3b3b818ac256eca9" Jul 21 14:25:23.081634 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:23.081551 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19c2ft"] Jul 21 14:25:23.085104 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:23.085087 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19c2ft" Jul 21 14:25:23.091013 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:23.090989 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 21 14:25:23.091151 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:23.091016 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 21 14:25:23.093355 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:23.093327 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-q6lsw\"" Jul 21 14:25:23.095905 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:23.095882 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19c2ft"] Jul 21 14:25:23.137253 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:23.137171 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3e724da8-d405-4665-b5b6-0f929b84444f-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19c2ft\" (UID: \"3e724da8-d405-4665-b5b6-0f929b84444f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19c2ft" Jul 21 14:25:23.137594 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:23.137351 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3e724da8-d405-4665-b5b6-0f929b84444f-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19c2ft\" (UID: \"3e724da8-d405-4665-b5b6-0f929b84444f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19c2ft" Jul 21 14:25:23.137594 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:23.137383 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4jg4\" (UniqueName: \"kubernetes.io/projected/3e724da8-d405-4665-b5b6-0f929b84444f-kube-api-access-r4jg4\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19c2ft\" (UID: \"3e724da8-d405-4665-b5b6-0f929b84444f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19c2ft" Jul 21 14:25:23.239069 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:23.238968 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3e724da8-d405-4665-b5b6-0f929b84444f-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19c2ft\" (UID: \"3e724da8-d405-4665-b5b6-0f929b84444f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19c2ft" Jul 21 14:25:23.239410 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:23.239156 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3e724da8-d405-4665-b5b6-0f929b84444f-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19c2ft\" (UID: \"3e724da8-d405-4665-b5b6-0f929b84444f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19c2ft" Jul 21 14:25:23.239410 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:23.239199 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4jg4\" (UniqueName: \"kubernetes.io/projected/3e724da8-d405-4665-b5b6-0f929b84444f-kube-api-access-r4jg4\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19c2ft\" (UID: \"3e724da8-d405-4665-b5b6-0f929b84444f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19c2ft" Jul 21 14:25:23.239672 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:23.239636 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3e724da8-d405-4665-b5b6-0f929b84444f-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19c2ft\" (UID: \"3e724da8-d405-4665-b5b6-0f929b84444f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19c2ft" Jul 21 14:25:23.239739 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:23.239641 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3e724da8-d405-4665-b5b6-0f929b84444f-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19c2ft\" (UID: \"3e724da8-d405-4665-b5b6-0f929b84444f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19c2ft" Jul 21 14:25:23.266724 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:23.266621 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4jg4\" (UniqueName: \"kubernetes.io/projected/3e724da8-d405-4665-b5b6-0f929b84444f-kube-api-access-r4jg4\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19c2ft\" (UID: \"3e724da8-d405-4665-b5b6-0f929b84444f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19c2ft" Jul 21 14:25:23.394987 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:23.394907 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19c2ft" Jul 21 14:25:23.573964 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:23.573927 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19c2ft"] Jul 21 14:25:23.577020 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:25:23.576976 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e724da8_d405_4665_b5b6_0f929b84444f.slice/crio-f584dabeb3f26f90609bab9ad5fd73f46526eaa5798d885436ea3c40b7085c62 WatchSource:0}: Error finding container f584dabeb3f26f90609bab9ad5fd73f46526eaa5798d885436ea3c40b7085c62: Status 404 returned error can't find the container with id f584dabeb3f26f90609bab9ad5fd73f46526eaa5798d885436ea3c40b7085c62 Jul 21 14:25:23.878642 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:23.878603 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jjvgd"] Jul 21 14:25:23.882189 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:23.882168 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jjvgd" Jul 21 14:25:23.895411 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:23.895343 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jjvgd"] Jul 21 14:25:23.945505 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:23.945380 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e604d143-3a00-49a2-a7fc-6807d3dcf1c3-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jjvgd\" (UID: \"e604d143-3a00-49a2-a7fc-6807d3dcf1c3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jjvgd" Jul 21 14:25:23.945505 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:23.945445 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e604d143-3a00-49a2-a7fc-6807d3dcf1c3-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jjvgd\" (UID: \"e604d143-3a00-49a2-a7fc-6807d3dcf1c3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jjvgd" Jul 21 14:25:23.945729 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:23.945551 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sghpv\" (UniqueName: \"kubernetes.io/projected/e604d143-3a00-49a2-a7fc-6807d3dcf1c3-kube-api-access-sghpv\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jjvgd\" (UID: \"e604d143-3a00-49a2-a7fc-6807d3dcf1c3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jjvgd" Jul 21 14:25:24.016141 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:24.016103 2576 generic.go:356] "Generic (PLEG): container finished" podID="3e724da8-d405-4665-b5b6-0f929b84444f" containerID="830beb10855374e53bf3d314e96778b512ba8bfb9125bca30c81e82290ace071" exitCode=0 Jul 21 14:25:24.016338 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:24.016151 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19c2ft" event={"ID":"3e724da8-d405-4665-b5b6-0f929b84444f","Type":"ContainerDied","Data":"830beb10855374e53bf3d314e96778b512ba8bfb9125bca30c81e82290ace071"} Jul 21 14:25:24.016338 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:24.016184 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19c2ft" event={"ID":"3e724da8-d405-4665-b5b6-0f929b84444f","Type":"ContainerStarted","Data":"f584dabeb3f26f90609bab9ad5fd73f46526eaa5798d885436ea3c40b7085c62"} Jul 21 14:25:24.046403 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:24.046379 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e604d143-3a00-49a2-a7fc-6807d3dcf1c3-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jjvgd\" (UID: \"e604d143-3a00-49a2-a7fc-6807d3dcf1c3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jjvgd" Jul 21 14:25:24.046517 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:24.046426 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sghpv\" (UniqueName: \"kubernetes.io/projected/e604d143-3a00-49a2-a7fc-6807d3dcf1c3-kube-api-access-sghpv\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jjvgd\" (UID: \"e604d143-3a00-49a2-a7fc-6807d3dcf1c3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jjvgd" Jul 21 14:25:24.046517 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:24.046497 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e604d143-3a00-49a2-a7fc-6807d3dcf1c3-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jjvgd\" (UID: \"e604d143-3a00-49a2-a7fc-6807d3dcf1c3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jjvgd" Jul 21 14:25:24.046730 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:24.046712 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e604d143-3a00-49a2-a7fc-6807d3dcf1c3-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jjvgd\" (UID: \"e604d143-3a00-49a2-a7fc-6807d3dcf1c3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jjvgd" Jul 21 14:25:24.046772 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:24.046762 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e604d143-3a00-49a2-a7fc-6807d3dcf1c3-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jjvgd\" (UID: \"e604d143-3a00-49a2-a7fc-6807d3dcf1c3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jjvgd" Jul 21 14:25:24.056141 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:24.056123 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sghpv\" (UniqueName: \"kubernetes.io/projected/e604d143-3a00-49a2-a7fc-6807d3dcf1c3-kube-api-access-sghpv\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jjvgd\" (UID: \"e604d143-3a00-49a2-a7fc-6807d3dcf1c3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jjvgd" Jul 21 14:25:24.194384 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:24.194328 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jjvgd" Jul 21 14:25:24.352259 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:24.352227 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jjvgd"] Jul 21 14:25:24.354179 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:25:24.354153 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode604d143_3a00_49a2_a7fc_6807d3dcf1c3.slice/crio-54a13fbd73d90b5e7d7d4f88607a419a3941062ee7120cc921f6f960508c26d2 WatchSource:0}: Error finding container 54a13fbd73d90b5e7d7d4f88607a419a3941062ee7120cc921f6f960508c26d2: Status 404 returned error can't find the container with id 54a13fbd73d90b5e7d7d4f88607a419a3941062ee7120cc921f6f960508c26d2 Jul 21 14:25:24.479814 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:24.479767 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nl4sl"] Jul 21 14:25:24.483201 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:24.483184 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nl4sl" Jul 21 14:25:24.494431 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:24.494370 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nl4sl"] Jul 21 14:25:24.551488 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:24.551435 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/851f7217-06ce-43af-aef3-59be5e50df3c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nl4sl\" (UID: \"851f7217-06ce-43af-aef3-59be5e50df3c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nl4sl" Jul 21 14:25:24.551687 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:24.551572 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/851f7217-06ce-43af-aef3-59be5e50df3c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nl4sl\" (UID: \"851f7217-06ce-43af-aef3-59be5e50df3c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nl4sl" Jul 21 14:25:24.551687 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:24.551616 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jzwg\" (UniqueName: \"kubernetes.io/projected/851f7217-06ce-43af-aef3-59be5e50df3c-kube-api-access-4jzwg\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nl4sl\" (UID: \"851f7217-06ce-43af-aef3-59be5e50df3c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nl4sl" Jul 21 14:25:24.652958 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:24.652913 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/851f7217-06ce-43af-aef3-59be5e50df3c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nl4sl\" (UID: \"851f7217-06ce-43af-aef3-59be5e50df3c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nl4sl" Jul 21 14:25:24.653132 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:24.653048 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/851f7217-06ce-43af-aef3-59be5e50df3c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nl4sl\" (UID: \"851f7217-06ce-43af-aef3-59be5e50df3c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nl4sl" Jul 21 14:25:24.653177 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:24.653157 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jzwg\" (UniqueName: \"kubernetes.io/projected/851f7217-06ce-43af-aef3-59be5e50df3c-kube-api-access-4jzwg\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nl4sl\" (UID: \"851f7217-06ce-43af-aef3-59be5e50df3c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nl4sl" Jul 21 14:25:24.653408 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:24.653382 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/851f7217-06ce-43af-aef3-59be5e50df3c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nl4sl\" (UID: \"851f7217-06ce-43af-aef3-59be5e50df3c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nl4sl" Jul 21 14:25:24.653517 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:24.653392 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/851f7217-06ce-43af-aef3-59be5e50df3c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nl4sl\" (UID: \"851f7217-06ce-43af-aef3-59be5e50df3c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nl4sl" Jul 21 14:25:24.663709 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:24.663686 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jzwg\" (UniqueName: \"kubernetes.io/projected/851f7217-06ce-43af-aef3-59be5e50df3c-kube-api-access-4jzwg\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nl4sl\" (UID: \"851f7217-06ce-43af-aef3-59be5e50df3c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nl4sl" Jul 21 14:25:24.832515 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:24.832459 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nl4sl" Jul 21 14:25:24.874500 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:24.874448 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pk45q"] Jul 21 14:25:24.879137 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:24.879077 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pk45q" Jul 21 14:25:24.888986 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:24.888954 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pk45q"] Jul 21 14:25:24.956510 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:24.956464 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f7e19c3f-a05f-48f6-adcf-ef759ab13b31-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pk45q\" (UID: \"f7e19c3f-a05f-48f6-adcf-ef759ab13b31\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pk45q" Jul 21 14:25:24.956690 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:24.956625 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f7e19c3f-a05f-48f6-adcf-ef759ab13b31-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pk45q\" (UID: \"f7e19c3f-a05f-48f6-adcf-ef759ab13b31\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pk45q" Jul 21 14:25:24.956690 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:24.956665 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-755c4\" (UniqueName: \"kubernetes.io/projected/f7e19c3f-a05f-48f6-adcf-ef759ab13b31-kube-api-access-755c4\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pk45q\" (UID: \"f7e19c3f-a05f-48f6-adcf-ef759ab13b31\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pk45q" Jul 21 14:25:24.992756 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:24.992728 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nl4sl"] Jul 21 14:25:24.994077 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:25:24.994049 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod851f7217_06ce_43af_aef3_59be5e50df3c.slice/crio-6e1659a12da7386d99c7ec9840d81742ef2ed4515fef3948994f9d63beee4c7b WatchSource:0}: Error finding container 6e1659a12da7386d99c7ec9840d81742ef2ed4515fef3948994f9d63beee4c7b: Status 404 returned error can't find the container with id 6e1659a12da7386d99c7ec9840d81742ef2ed4515fef3948994f9d63beee4c7b Jul 21 14:25:25.024563 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:25.024508 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nl4sl" event={"ID":"851f7217-06ce-43af-aef3-59be5e50df3c","Type":"ContainerStarted","Data":"6e1659a12da7386d99c7ec9840d81742ef2ed4515fef3948994f9d63beee4c7b"} Jul 21 14:25:25.026926 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:25.026886 2576 generic.go:356] "Generic (PLEG): container finished" podID="e604d143-3a00-49a2-a7fc-6807d3dcf1c3" containerID="3d1ddc00ac45523cf00eca2d89705b5134079ed92502c122e4b30860c085c542" exitCode=0 Jul 21 14:25:25.027124 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:25.027007 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jjvgd" event={"ID":"e604d143-3a00-49a2-a7fc-6807d3dcf1c3","Type":"ContainerDied","Data":"3d1ddc00ac45523cf00eca2d89705b5134079ed92502c122e4b30860c085c542"} Jul 21 14:25:25.027124 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:25.027085 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jjvgd" event={"ID":"e604d143-3a00-49a2-a7fc-6807d3dcf1c3","Type":"ContainerStarted","Data":"54a13fbd73d90b5e7d7d4f88607a419a3941062ee7120cc921f6f960508c26d2"} Jul 21 14:25:25.058150 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:25.058104 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-755c4\" (UniqueName: \"kubernetes.io/projected/f7e19c3f-a05f-48f6-adcf-ef759ab13b31-kube-api-access-755c4\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pk45q\" (UID: \"f7e19c3f-a05f-48f6-adcf-ef759ab13b31\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pk45q" Jul 21 14:25:25.058390 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:25.058184 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f7e19c3f-a05f-48f6-adcf-ef759ab13b31-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pk45q\" (UID: \"f7e19c3f-a05f-48f6-adcf-ef759ab13b31\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pk45q" Jul 21 14:25:25.058390 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:25.058318 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f7e19c3f-a05f-48f6-adcf-ef759ab13b31-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pk45q\" (UID: \"f7e19c3f-a05f-48f6-adcf-ef759ab13b31\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pk45q" Jul 21 14:25:25.058889 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:25.058863 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f7e19c3f-a05f-48f6-adcf-ef759ab13b31-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pk45q\" (UID: \"f7e19c3f-a05f-48f6-adcf-ef759ab13b31\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pk45q" Jul 21 14:25:25.058985 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:25.058864 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f7e19c3f-a05f-48f6-adcf-ef759ab13b31-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pk45q\" (UID: \"f7e19c3f-a05f-48f6-adcf-ef759ab13b31\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pk45q" Jul 21 14:25:25.069884 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:25.069727 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-755c4\" (UniqueName: \"kubernetes.io/projected/f7e19c3f-a05f-48f6-adcf-ef759ab13b31-kube-api-access-755c4\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pk45q\" (UID: \"f7e19c3f-a05f-48f6-adcf-ef759ab13b31\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pk45q" Jul 21 14:25:25.195659 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:25.195624 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pk45q" Jul 21 14:25:25.389959 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:25.389919 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pk45q"] Jul 21 14:25:25.420432 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:25:25.420374 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7e19c3f_a05f_48f6_adcf_ef759ab13b31.slice/crio-c8b1404ce73c3121692ce5687d0f62b89099908616add132efc622c885ee856e WatchSource:0}: Error finding container c8b1404ce73c3121692ce5687d0f62b89099908616add132efc622c885ee856e: Status 404 returned error can't find the container with id c8b1404ce73c3121692ce5687d0f62b89099908616add132efc622c885ee856e Jul 21 14:25:26.034963 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:26.034920 2576 generic.go:356] "Generic (PLEG): container finished" podID="851f7217-06ce-43af-aef3-59be5e50df3c" containerID="21ab080960675b4c0266c8a61ad959f8656a162e559f3a7bbf7ab2d39783b57a" exitCode=0 Jul 21 14:25:26.035231 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:26.035002 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nl4sl" event={"ID":"851f7217-06ce-43af-aef3-59be5e50df3c","Type":"ContainerDied","Data":"21ab080960675b4c0266c8a61ad959f8656a162e559f3a7bbf7ab2d39783b57a"} Jul 21 14:25:26.037834 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:26.037730 2576 generic.go:356] "Generic (PLEG): container finished" podID="3e724da8-d405-4665-b5b6-0f929b84444f" containerID="ae0c9e45c43d259b2800cb48d086d5031a79a408ffab50f0b50c6c5a6a2bda3e" exitCode=0 Jul 21 14:25:26.038080 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:26.037837 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19c2ft" event={"ID":"3e724da8-d405-4665-b5b6-0f929b84444f","Type":"ContainerDied","Data":"ae0c9e45c43d259b2800cb48d086d5031a79a408ffab50f0b50c6c5a6a2bda3e"} Jul 21 14:25:26.040251 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:26.040213 2576 generic.go:356] "Generic (PLEG): container finished" podID="f7e19c3f-a05f-48f6-adcf-ef759ab13b31" containerID="ed954d70f64676bdbbc52fa48b0e12cb52c924741b294b9ba53219acdc855b44" exitCode=0 Jul 21 14:25:26.040467 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:26.040268 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pk45q" event={"ID":"f7e19c3f-a05f-48f6-adcf-ef759ab13b31","Type":"ContainerDied","Data":"ed954d70f64676bdbbc52fa48b0e12cb52c924741b294b9ba53219acdc855b44"} Jul 21 14:25:26.040540 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:26.040472 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pk45q" event={"ID":"f7e19c3f-a05f-48f6-adcf-ef759ab13b31","Type":"ContainerStarted","Data":"c8b1404ce73c3121692ce5687d0f62b89099908616add132efc622c885ee856e"} Jul 21 14:25:27.049695 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:27.049660 2576 generic.go:356] "Generic (PLEG): container finished" podID="e604d143-3a00-49a2-a7fc-6807d3dcf1c3" containerID="d51914ee5bf0e254dc01107aea1506c4af3854401982ad7da07fee0657e7714f" exitCode=0 Jul 21 14:25:27.050133 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:27.049737 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jjvgd" event={"ID":"e604d143-3a00-49a2-a7fc-6807d3dcf1c3","Type":"ContainerDied","Data":"d51914ee5bf0e254dc01107aea1506c4af3854401982ad7da07fee0657e7714f"} Jul 21 14:25:27.052670 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:27.052614 2576 generic.go:356] "Generic (PLEG): container finished" podID="3e724da8-d405-4665-b5b6-0f929b84444f" containerID="fbce6476a006884b8f2abe727e55008be69b818e6696cb6cca95698924053aa7" exitCode=0 Jul 21 14:25:27.052848 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:27.052721 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19c2ft" event={"ID":"3e724da8-d405-4665-b5b6-0f929b84444f","Type":"ContainerDied","Data":"fbce6476a006884b8f2abe727e55008be69b818e6696cb6cca95698924053aa7"} Jul 21 14:25:28.062360 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:28.062328 2576 generic.go:356] "Generic (PLEG): container finished" podID="f7e19c3f-a05f-48f6-adcf-ef759ab13b31" containerID="3fe3dd32aca167cc9f905958c2ac85069df5ece287efcde394a4195955c62aba" exitCode=0 Jul 21 14:25:28.062878 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:28.062410 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pk45q" event={"ID":"f7e19c3f-a05f-48f6-adcf-ef759ab13b31","Type":"ContainerDied","Data":"3fe3dd32aca167cc9f905958c2ac85069df5ece287efcde394a4195955c62aba"} Jul 21 14:25:28.064540 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:28.064511 2576 generic.go:356] "Generic (PLEG): container finished" podID="851f7217-06ce-43af-aef3-59be5e50df3c" containerID="1327d6e01059698edcfb430dfa97318ccb7fd3a7385bdca598d9319ceb31ed72" exitCode=0 Jul 21 14:25:28.064629 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:28.064557 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nl4sl" event={"ID":"851f7217-06ce-43af-aef3-59be5e50df3c","Type":"ContainerDied","Data":"1327d6e01059698edcfb430dfa97318ccb7fd3a7385bdca598d9319ceb31ed72"} Jul 21 14:25:28.066943 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:28.066923 2576 generic.go:356] "Generic (PLEG): container finished" podID="e604d143-3a00-49a2-a7fc-6807d3dcf1c3" containerID="e6fdffde444b9bae595c66c4193c722f4ef641caf5326d3dee9ca887431919b4" exitCode=0 Jul 21 14:25:28.067035 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:28.067001 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jjvgd" event={"ID":"e604d143-3a00-49a2-a7fc-6807d3dcf1c3","Type":"ContainerDied","Data":"e6fdffde444b9bae595c66c4193c722f4ef641caf5326d3dee9ca887431919b4"} Jul 21 14:25:28.240255 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:28.240198 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19c2ft" Jul 21 14:25:28.295326 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:28.295269 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3e724da8-d405-4665-b5b6-0f929b84444f-bundle\") pod \"3e724da8-d405-4665-b5b6-0f929b84444f\" (UID: \"3e724da8-d405-4665-b5b6-0f929b84444f\") " Jul 21 14:25:28.295611 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:28.295372 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r4jg4\" (UniqueName: \"kubernetes.io/projected/3e724da8-d405-4665-b5b6-0f929b84444f-kube-api-access-r4jg4\") pod \"3e724da8-d405-4665-b5b6-0f929b84444f\" (UID: \"3e724da8-d405-4665-b5b6-0f929b84444f\") " Jul 21 14:25:28.295611 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:28.295458 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3e724da8-d405-4665-b5b6-0f929b84444f-util\") pod \"3e724da8-d405-4665-b5b6-0f929b84444f\" (UID: \"3e724da8-d405-4665-b5b6-0f929b84444f\") " Jul 21 14:25:28.296098 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:28.296060 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e724da8-d405-4665-b5b6-0f929b84444f-bundle" (OuterVolumeSpecName: "bundle") pod "3e724da8-d405-4665-b5b6-0f929b84444f" (UID: "3e724da8-d405-4665-b5b6-0f929b84444f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:25:28.298612 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:28.298573 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e724da8-d405-4665-b5b6-0f929b84444f-kube-api-access-r4jg4" (OuterVolumeSpecName: "kube-api-access-r4jg4") pod "3e724da8-d405-4665-b5b6-0f929b84444f" (UID: "3e724da8-d405-4665-b5b6-0f929b84444f"). InnerVolumeSpecName "kube-api-access-r4jg4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 14:25:28.303090 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:28.303040 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e724da8-d405-4665-b5b6-0f929b84444f-util" (OuterVolumeSpecName: "util") pod "3e724da8-d405-4665-b5b6-0f929b84444f" (UID: "3e724da8-d405-4665-b5b6-0f929b84444f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:25:28.396638 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:28.396567 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3e724da8-d405-4665-b5b6-0f929b84444f-bundle\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:25:28.396638 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:28.396619 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r4jg4\" (UniqueName: \"kubernetes.io/projected/3e724da8-d405-4665-b5b6-0f929b84444f-kube-api-access-r4jg4\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:25:28.396638 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:28.396631 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3e724da8-d405-4665-b5b6-0f929b84444f-util\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:25:29.074608 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:29.074572 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19c2ft" Jul 21 14:25:29.074608 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:29.074586 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19c2ft" event={"ID":"3e724da8-d405-4665-b5b6-0f929b84444f","Type":"ContainerDied","Data":"f584dabeb3f26f90609bab9ad5fd73f46526eaa5798d885436ea3c40b7085c62"} Jul 21 14:25:29.075205 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:29.074649 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f584dabeb3f26f90609bab9ad5fd73f46526eaa5798d885436ea3c40b7085c62" Jul 21 14:25:29.077203 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:29.077165 2576 generic.go:356] "Generic (PLEG): container finished" podID="f7e19c3f-a05f-48f6-adcf-ef759ab13b31" containerID="e6fc5c1e784a39dbc5e8127d8042cc96437e4f4ce007cc6facc8eaf34cfbd265" exitCode=0 Jul 21 14:25:29.077392 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:29.077250 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pk45q" event={"ID":"f7e19c3f-a05f-48f6-adcf-ef759ab13b31","Type":"ContainerDied","Data":"e6fc5c1e784a39dbc5e8127d8042cc96437e4f4ce007cc6facc8eaf34cfbd265"} Jul 21 14:25:29.079808 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:29.079761 2576 generic.go:356] "Generic (PLEG): container finished" podID="851f7217-06ce-43af-aef3-59be5e50df3c" containerID="c14e9858c0d8b1e261edbba649ae4d42202c024363e6991c3c4c249ff7f27657" exitCode=0 Jul 21 14:25:29.079958 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:29.079813 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nl4sl" event={"ID":"851f7217-06ce-43af-aef3-59be5e50df3c","Type":"ContainerDied","Data":"c14e9858c0d8b1e261edbba649ae4d42202c024363e6991c3c4c249ff7f27657"} Jul 21 14:25:29.237447 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:29.237385 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jjvgd" Jul 21 14:25:29.305570 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:29.305538 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sghpv\" (UniqueName: \"kubernetes.io/projected/e604d143-3a00-49a2-a7fc-6807d3dcf1c3-kube-api-access-sghpv\") pod \"e604d143-3a00-49a2-a7fc-6807d3dcf1c3\" (UID: \"e604d143-3a00-49a2-a7fc-6807d3dcf1c3\") " Jul 21 14:25:29.305827 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:29.305583 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e604d143-3a00-49a2-a7fc-6807d3dcf1c3-util\") pod \"e604d143-3a00-49a2-a7fc-6807d3dcf1c3\" (UID: \"e604d143-3a00-49a2-a7fc-6807d3dcf1c3\") " Jul 21 14:25:29.305827 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:29.305657 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e604d143-3a00-49a2-a7fc-6807d3dcf1c3-bundle\") pod \"e604d143-3a00-49a2-a7fc-6807d3dcf1c3\" (UID: \"e604d143-3a00-49a2-a7fc-6807d3dcf1c3\") " Jul 21 14:25:29.306185 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:29.306149 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e604d143-3a00-49a2-a7fc-6807d3dcf1c3-bundle" (OuterVolumeSpecName: "bundle") pod "e604d143-3a00-49a2-a7fc-6807d3dcf1c3" (UID: "e604d143-3a00-49a2-a7fc-6807d3dcf1c3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:25:29.307744 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:29.307720 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e604d143-3a00-49a2-a7fc-6807d3dcf1c3-kube-api-access-sghpv" (OuterVolumeSpecName: "kube-api-access-sghpv") pod "e604d143-3a00-49a2-a7fc-6807d3dcf1c3" (UID: "e604d143-3a00-49a2-a7fc-6807d3dcf1c3"). InnerVolumeSpecName "kube-api-access-sghpv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 14:25:29.310895 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:29.310854 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e604d143-3a00-49a2-a7fc-6807d3dcf1c3-util" (OuterVolumeSpecName: "util") pod "e604d143-3a00-49a2-a7fc-6807d3dcf1c3" (UID: "e604d143-3a00-49a2-a7fc-6807d3dcf1c3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:25:29.407303 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:29.407197 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e604d143-3a00-49a2-a7fc-6807d3dcf1c3-util\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:25:29.407303 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:29.407239 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e604d143-3a00-49a2-a7fc-6807d3dcf1c3-bundle\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:25:29.407303 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:29.407251 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sghpv\" (UniqueName: \"kubernetes.io/projected/e604d143-3a00-49a2-a7fc-6807d3dcf1c3-kube-api-access-sghpv\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:25:30.087929 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:30.087887 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jjvgd" Jul 21 14:25:30.088361 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:30.087886 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jjvgd" event={"ID":"e604d143-3a00-49a2-a7fc-6807d3dcf1c3","Type":"ContainerDied","Data":"54a13fbd73d90b5e7d7d4f88607a419a3941062ee7120cc921f6f960508c26d2"} Jul 21 14:25:30.088361 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:30.088020 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="54a13fbd73d90b5e7d7d4f88607a419a3941062ee7120cc921f6f960508c26d2" Jul 21 14:25:30.271924 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:30.271883 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nl4sl" Jul 21 14:25:30.275577 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:30.275537 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pk45q" Jul 21 14:25:30.316386 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:30.316360 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4jzwg\" (UniqueName: \"kubernetes.io/projected/851f7217-06ce-43af-aef3-59be5e50df3c-kube-api-access-4jzwg\") pod \"851f7217-06ce-43af-aef3-59be5e50df3c\" (UID: \"851f7217-06ce-43af-aef3-59be5e50df3c\") " Jul 21 14:25:30.316552 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:30.316441 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-755c4\" (UniqueName: \"kubernetes.io/projected/f7e19c3f-a05f-48f6-adcf-ef759ab13b31-kube-api-access-755c4\") pod \"f7e19c3f-a05f-48f6-adcf-ef759ab13b31\" (UID: \"f7e19c3f-a05f-48f6-adcf-ef759ab13b31\") " Jul 21 14:25:30.316628 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:30.316609 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/851f7217-06ce-43af-aef3-59be5e50df3c-bundle\") pod \"851f7217-06ce-43af-aef3-59be5e50df3c\" (UID: \"851f7217-06ce-43af-aef3-59be5e50df3c\") " Jul 21 14:25:30.316690 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:30.316656 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f7e19c3f-a05f-48f6-adcf-ef759ab13b31-bundle\") pod \"f7e19c3f-a05f-48f6-adcf-ef759ab13b31\" (UID: \"f7e19c3f-a05f-48f6-adcf-ef759ab13b31\") " Jul 21 14:25:30.316690 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:30.316685 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f7e19c3f-a05f-48f6-adcf-ef759ab13b31-util\") pod \"f7e19c3f-a05f-48f6-adcf-ef759ab13b31\" (UID: \"f7e19c3f-a05f-48f6-adcf-ef759ab13b31\") " Jul 21 14:25:30.316837 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:30.316727 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/851f7217-06ce-43af-aef3-59be5e50df3c-util\") pod \"851f7217-06ce-43af-aef3-59be5e50df3c\" (UID: \"851f7217-06ce-43af-aef3-59be5e50df3c\") " Jul 21 14:25:30.317099 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:30.317077 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7e19c3f-a05f-48f6-adcf-ef759ab13b31-bundle" (OuterVolumeSpecName: "bundle") pod "f7e19c3f-a05f-48f6-adcf-ef759ab13b31" (UID: "f7e19c3f-a05f-48f6-adcf-ef759ab13b31"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:25:30.317493 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:30.317329 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/851f7217-06ce-43af-aef3-59be5e50df3c-bundle" (OuterVolumeSpecName: "bundle") pod "851f7217-06ce-43af-aef3-59be5e50df3c" (UID: "851f7217-06ce-43af-aef3-59be5e50df3c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:25:30.319035 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:30.319008 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/851f7217-06ce-43af-aef3-59be5e50df3c-kube-api-access-4jzwg" (OuterVolumeSpecName: "kube-api-access-4jzwg") pod "851f7217-06ce-43af-aef3-59be5e50df3c" (UID: "851f7217-06ce-43af-aef3-59be5e50df3c"). InnerVolumeSpecName "kube-api-access-4jzwg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 14:25:30.319118 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:30.319036 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7e19c3f-a05f-48f6-adcf-ef759ab13b31-kube-api-access-755c4" (OuterVolumeSpecName: "kube-api-access-755c4") pod "f7e19c3f-a05f-48f6-adcf-ef759ab13b31" (UID: "f7e19c3f-a05f-48f6-adcf-ef759ab13b31"). InnerVolumeSpecName "kube-api-access-755c4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 14:25:30.324570 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:30.324519 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7e19c3f-a05f-48f6-adcf-ef759ab13b31-util" (OuterVolumeSpecName: "util") pod "f7e19c3f-a05f-48f6-adcf-ef759ab13b31" (UID: "f7e19c3f-a05f-48f6-adcf-ef759ab13b31"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:25:30.324682 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:30.324581 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/851f7217-06ce-43af-aef3-59be5e50df3c-util" (OuterVolumeSpecName: "util") pod "851f7217-06ce-43af-aef3-59be5e50df3c" (UID: "851f7217-06ce-43af-aef3-59be5e50df3c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:25:30.417699 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:30.417610 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-755c4\" (UniqueName: \"kubernetes.io/projected/f7e19c3f-a05f-48f6-adcf-ef759ab13b31-kube-api-access-755c4\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:25:30.417699 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:30.417654 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/851f7217-06ce-43af-aef3-59be5e50df3c-bundle\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:25:30.417699 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:30.417665 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f7e19c3f-a05f-48f6-adcf-ef759ab13b31-bundle\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:25:30.417699 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:30.417672 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f7e19c3f-a05f-48f6-adcf-ef759ab13b31-util\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:25:30.417699 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:30.417681 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/851f7217-06ce-43af-aef3-59be5e50df3c-util\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:25:30.417699 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:30.417689 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4jzwg\" (UniqueName: \"kubernetes.io/projected/851f7217-06ce-43af-aef3-59be5e50df3c-kube-api-access-4jzwg\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:25:31.098737 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:31.098687 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pk45q" Jul 21 14:25:31.099364 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:31.098670 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pk45q" event={"ID":"f7e19c3f-a05f-48f6-adcf-ef759ab13b31","Type":"ContainerDied","Data":"c8b1404ce73c3121692ce5687d0f62b89099908616add132efc622c885ee856e"} Jul 21 14:25:31.099364 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:31.098855 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c8b1404ce73c3121692ce5687d0f62b89099908616add132efc622c885ee856e" Jul 21 14:25:31.101498 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:31.101446 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nl4sl" event={"ID":"851f7217-06ce-43af-aef3-59be5e50df3c","Type":"ContainerDied","Data":"6e1659a12da7386d99c7ec9840d81742ef2ed4515fef3948994f9d63beee4c7b"} Jul 21 14:25:31.101748 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:31.101523 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6e1659a12da7386d99c7ec9840d81742ef2ed4515fef3948994f9d63beee4c7b" Jul 21 14:25:31.101748 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:25:31.101574 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nl4sl" Jul 21 14:26:11.538609 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:11.538554 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4rrmj"] Jul 21 14:26:11.539313 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:11.539024 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e724da8-d405-4665-b5b6-0f929b84444f" containerName="extract" Jul 21 14:26:11.539313 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:11.539038 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e724da8-d405-4665-b5b6-0f929b84444f" containerName="extract" Jul 21 14:26:11.539313 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:11.539047 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7e19c3f-a05f-48f6-adcf-ef759ab13b31" containerName="extract" Jul 21 14:26:11.539313 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:11.539053 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7e19c3f-a05f-48f6-adcf-ef759ab13b31" containerName="extract" Jul 21 14:26:11.539313 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:11.539063 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="851f7217-06ce-43af-aef3-59be5e50df3c" containerName="extract" Jul 21 14:26:11.539313 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:11.539069 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="851f7217-06ce-43af-aef3-59be5e50df3c" containerName="extract" Jul 21 14:26:11.539313 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:11.539079 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7e19c3f-a05f-48f6-adcf-ef759ab13b31" containerName="pull" Jul 21 14:26:11.539313 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:11.539085 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7e19c3f-a05f-48f6-adcf-ef759ab13b31" containerName="pull" Jul 21 14:26:11.539313 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:11.539096 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7e19c3f-a05f-48f6-adcf-ef759ab13b31" containerName="util" Jul 21 14:26:11.539313 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:11.539101 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7e19c3f-a05f-48f6-adcf-ef759ab13b31" containerName="util" Jul 21 14:26:11.539313 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:11.539108 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="851f7217-06ce-43af-aef3-59be5e50df3c" containerName="pull" Jul 21 14:26:11.539313 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:11.539114 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="851f7217-06ce-43af-aef3-59be5e50df3c" containerName="pull" Jul 21 14:26:11.539313 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:11.539122 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e604d143-3a00-49a2-a7fc-6807d3dcf1c3" containerName="pull" Jul 21 14:26:11.539313 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:11.539127 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e604d143-3a00-49a2-a7fc-6807d3dcf1c3" containerName="pull" Jul 21 14:26:11.539313 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:11.539138 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="851f7217-06ce-43af-aef3-59be5e50df3c" containerName="util" Jul 21 14:26:11.539313 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:11.539143 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="851f7217-06ce-43af-aef3-59be5e50df3c" containerName="util" Jul 21 14:26:11.539313 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:11.539150 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e604d143-3a00-49a2-a7fc-6807d3dcf1c3" containerName="util" Jul 21 14:26:11.539313 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:11.539156 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e604d143-3a00-49a2-a7fc-6807d3dcf1c3" containerName="util" Jul 21 14:26:11.539313 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:11.539163 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e724da8-d405-4665-b5b6-0f929b84444f" containerName="pull" Jul 21 14:26:11.539313 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:11.539168 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e724da8-d405-4665-b5b6-0f929b84444f" containerName="pull" Jul 21 14:26:11.539313 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:11.539174 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e604d143-3a00-49a2-a7fc-6807d3dcf1c3" containerName="extract" Jul 21 14:26:11.539313 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:11.539180 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e604d143-3a00-49a2-a7fc-6807d3dcf1c3" containerName="extract" Jul 21 14:26:11.539313 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:11.539187 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e724da8-d405-4665-b5b6-0f929b84444f" containerName="util" Jul 21 14:26:11.539313 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:11.539192 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e724da8-d405-4665-b5b6-0f929b84444f" containerName="util" Jul 21 14:26:11.539313 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:11.539280 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e724da8-d405-4665-b5b6-0f929b84444f" containerName="extract" Jul 21 14:26:11.539313 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:11.539289 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e604d143-3a00-49a2-a7fc-6807d3dcf1c3" containerName="extract" Jul 21 14:26:11.539313 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:11.539297 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="851f7217-06ce-43af-aef3-59be5e50df3c" containerName="extract" Jul 21 14:26:11.539313 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:11.539305 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7e19c3f-a05f-48f6-adcf-ef759ab13b31" containerName="extract" Jul 21 14:26:11.544104 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:11.544073 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4rrmj" Jul 21 14:26:11.547614 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:11.547570 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 21 14:26:11.547614 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:11.547571 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 21 14:26:11.547921 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:11.547625 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-82jnm\"" Jul 21 14:26:11.557065 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:11.557019 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4rrmj"] Jul 21 14:26:11.611893 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:11.611842 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/39efdfe1-dfd2-40ef-a531-2cc2060bcbf1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4rrmj\" (UID: \"39efdfe1-dfd2-40ef-a531-2cc2060bcbf1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4rrmj" Jul 21 14:26:11.612167 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:11.611929 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x66cb\" (UniqueName: \"kubernetes.io/projected/39efdfe1-dfd2-40ef-a531-2cc2060bcbf1-kube-api-access-x66cb\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4rrmj\" (UID: \"39efdfe1-dfd2-40ef-a531-2cc2060bcbf1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4rrmj" Jul 21 14:26:11.713462 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:11.713413 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/39efdfe1-dfd2-40ef-a531-2cc2060bcbf1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4rrmj\" (UID: \"39efdfe1-dfd2-40ef-a531-2cc2060bcbf1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4rrmj" Jul 21 14:26:11.713462 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:11.713468 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x66cb\" (UniqueName: \"kubernetes.io/projected/39efdfe1-dfd2-40ef-a531-2cc2060bcbf1-kube-api-access-x66cb\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4rrmj\" (UID: \"39efdfe1-dfd2-40ef-a531-2cc2060bcbf1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4rrmj" Jul 21 14:26:11.713943 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:11.713917 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/39efdfe1-dfd2-40ef-a531-2cc2060bcbf1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4rrmj\" (UID: \"39efdfe1-dfd2-40ef-a531-2cc2060bcbf1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4rrmj" Jul 21 14:26:11.723806 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:11.723757 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x66cb\" (UniqueName: \"kubernetes.io/projected/39efdfe1-dfd2-40ef-a531-2cc2060bcbf1-kube-api-access-x66cb\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4rrmj\" (UID: \"39efdfe1-dfd2-40ef-a531-2cc2060bcbf1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4rrmj" Jul 21 14:26:11.857450 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:11.857344 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4rrmj" Jul 21 14:26:12.037965 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:12.037892 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4rrmj"] Jul 21 14:26:12.038213 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:26:12.037906 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39efdfe1_dfd2_40ef_a531_2cc2060bcbf1.slice/crio-034b11ad1c6a9c6a207c8297bd73ca3c7e8f096285f0d2a037ad3e2606a2adcf WatchSource:0}: Error finding container 034b11ad1c6a9c6a207c8297bd73ca3c7e8f096285f0d2a037ad3e2606a2adcf: Status 404 returned error can't find the container with id 034b11ad1c6a9c6a207c8297bd73ca3c7e8f096285f0d2a037ad3e2606a2adcf Jul 21 14:26:12.183967 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:12.183819 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4rrmj"] Jul 21 14:26:12.189886 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:12.189832 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4rrmj"] Jul 21 14:26:12.237163 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:12.237112 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kx8d6"] Jul 21 14:26:12.242619 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:12.242580 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kx8d6" Jul 21 14:26:12.267802 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:12.267731 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kx8d6"] Jul 21 14:26:12.320229 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:12.320154 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vd7d\" (UniqueName: \"kubernetes.io/projected/47c81784-acac-4c12-99ea-a2665a27b7d2-kube-api-access-5vd7d\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kx8d6\" (UID: \"47c81784-acac-4c12-99ea-a2665a27b7d2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kx8d6" Jul 21 14:26:12.320513 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:12.320286 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/47c81784-acac-4c12-99ea-a2665a27b7d2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kx8d6\" (UID: \"47c81784-acac-4c12-99ea-a2665a27b7d2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kx8d6" Jul 21 14:26:12.421617 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:12.421579 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vd7d\" (UniqueName: \"kubernetes.io/projected/47c81784-acac-4c12-99ea-a2665a27b7d2-kube-api-access-5vd7d\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kx8d6\" (UID: \"47c81784-acac-4c12-99ea-a2665a27b7d2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kx8d6" Jul 21 14:26:12.421825 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:12.421632 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/47c81784-acac-4c12-99ea-a2665a27b7d2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kx8d6\" (UID: \"47c81784-acac-4c12-99ea-a2665a27b7d2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kx8d6" Jul 21 14:26:12.422041 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:12.422024 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/47c81784-acac-4c12-99ea-a2665a27b7d2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kx8d6\" (UID: \"47c81784-acac-4c12-99ea-a2665a27b7d2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kx8d6" Jul 21 14:26:12.431264 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:12.431243 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vd7d\" (UniqueName: \"kubernetes.io/projected/47c81784-acac-4c12-99ea-a2665a27b7d2-kube-api-access-5vd7d\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kx8d6\" (UID: \"47c81784-acac-4c12-99ea-a2665a27b7d2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kx8d6" Jul 21 14:26:12.560876 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:12.560772 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kx8d6" Jul 21 14:26:12.719671 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:12.719438 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kx8d6"] Jul 21 14:26:12.723669 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:26:12.723631 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47c81784_acac_4c12_99ea_a2665a27b7d2.slice/crio-fba69444dd65bedac3082793eb19369c1a1cecc096c8807411a4720f084ab146 WatchSource:0}: Error finding container fba69444dd65bedac3082793eb19369c1a1cecc096c8807411a4720f084ab146: Status 404 returned error can't find the container with id fba69444dd65bedac3082793eb19369c1a1cecc096c8807411a4720f084ab146 Jul 21 14:26:13.359292 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:13.359008 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kx8d6" event={"ID":"47c81784-acac-4c12-99ea-a2665a27b7d2","Type":"ContainerStarted","Data":"fba69444dd65bedac3082793eb19369c1a1cecc096c8807411a4720f084ab146"} Jul 21 14:26:17.389636 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:17.389592 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kx8d6" event={"ID":"47c81784-acac-4c12-99ea-a2665a27b7d2","Type":"ContainerStarted","Data":"bd39cd36c24e0fd2f57742c4b5d35b30219fe01f963aba646a5a3e557160d059"} Jul 21 14:26:17.390207 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:17.389661 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kx8d6" Jul 21 14:26:17.391655 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:17.391622 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4rrmj" podUID="39efdfe1-dfd2-40ef-a531-2cc2060bcbf1" containerName="manager" containerID="cri-o://d7230ba75c2d8c460e08c9d922b4da91803d60b2af11425547f08772cca8b405" gracePeriod=2 Jul 21 14:26:17.418934 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:17.418839 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kx8d6" podStartSLOduration=1.28171696 podStartE2EDuration="5.418773095s" totalImagesPullingTime="4.137056135s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:26:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:26:17.414993043 +0000 UTC m=+504.432896618" watchObservedRunningTime="2026-07-21 14:26:17.418773095 +0000 UTC m=+504.436676669" Jul 21 14:26:17.664379 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:17.664333 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4rrmj" Jul 21 14:26:17.775483 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:17.775421 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/39efdfe1-dfd2-40ef-a531-2cc2060bcbf1-extensions-socket-volume\") pod \"39efdfe1-dfd2-40ef-a531-2cc2060bcbf1\" (UID: \"39efdfe1-dfd2-40ef-a531-2cc2060bcbf1\") " Jul 21 14:26:17.775873 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:17.775557 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x66cb\" (UniqueName: \"kubernetes.io/projected/39efdfe1-dfd2-40ef-a531-2cc2060bcbf1-kube-api-access-x66cb\") pod \"39efdfe1-dfd2-40ef-a531-2cc2060bcbf1\" (UID: \"39efdfe1-dfd2-40ef-a531-2cc2060bcbf1\") " Jul 21 14:26:17.776015 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:17.775979 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39efdfe1-dfd2-40ef-a531-2cc2060bcbf1-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "39efdfe1-dfd2-40ef-a531-2cc2060bcbf1" (UID: "39efdfe1-dfd2-40ef-a531-2cc2060bcbf1"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:26:17.779072 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:17.779012 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39efdfe1-dfd2-40ef-a531-2cc2060bcbf1-kube-api-access-x66cb" (OuterVolumeSpecName: "kube-api-access-x66cb") pod "39efdfe1-dfd2-40ef-a531-2cc2060bcbf1" (UID: "39efdfe1-dfd2-40ef-a531-2cc2060bcbf1"). InnerVolumeSpecName "kube-api-access-x66cb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 14:26:17.877149 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:17.877091 2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/39efdfe1-dfd2-40ef-a531-2cc2060bcbf1-extensions-socket-volume\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:26:17.877149 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:17.877144 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x66cb\" (UniqueName: \"kubernetes.io/projected/39efdfe1-dfd2-40ef-a531-2cc2060bcbf1-kube-api-access-x66cb\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:26:18.398994 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:18.398955 2576 generic.go:356] "Generic (PLEG): container finished" podID="39efdfe1-dfd2-40ef-a531-2cc2060bcbf1" containerID="d7230ba75c2d8c460e08c9d922b4da91803d60b2af11425547f08772cca8b405" exitCode=2 Jul 21 14:26:18.399432 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:18.399006 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4rrmj" Jul 21 14:26:18.399432 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:18.399061 2576 scope.go:117] "RemoveContainer" containerID="d7230ba75c2d8c460e08c9d922b4da91803d60b2af11425547f08772cca8b405" Jul 21 14:26:18.401633 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:26:18.401602 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-4rrmj\" is forbidden: User \"system:node:ip-10-0-140-199.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-199.ec2.internal' and this object" podUID="39efdfe1-dfd2-40ef-a531-2cc2060bcbf1" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4rrmj" Jul 21 14:26:18.410009 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:18.409988 2576 scope.go:117] "RemoveContainer" containerID="d7230ba75c2d8c460e08c9d922b4da91803d60b2af11425547f08772cca8b405" Jul 21 14:26:18.410316 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:26:18.410284 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-4rrmj\" is forbidden: User \"system:node:ip-10-0-140-199.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-199.ec2.internal' and this object" podUID="39efdfe1-dfd2-40ef-a531-2cc2060bcbf1" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4rrmj" Jul 21 14:26:18.410436 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:26:18.410341 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7230ba75c2d8c460e08c9d922b4da91803d60b2af11425547f08772cca8b405\": container with ID starting with d7230ba75c2d8c460e08c9d922b4da91803d60b2af11425547f08772cca8b405 not found: ID does not exist" containerID="d7230ba75c2d8c460e08c9d922b4da91803d60b2af11425547f08772cca8b405" Jul 21 14:26:18.410436 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:18.410372 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7230ba75c2d8c460e08c9d922b4da91803d60b2af11425547f08772cca8b405"} err="failed to get container status \"d7230ba75c2d8c460e08c9d922b4da91803d60b2af11425547f08772cca8b405\": rpc error: code = NotFound desc = could not find container \"d7230ba75c2d8c460e08c9d922b4da91803d60b2af11425547f08772cca8b405\": container with ID starting with d7230ba75c2d8c460e08c9d922b4da91803d60b2af11425547f08772cca8b405 not found: ID does not exist" Jul 21 14:26:19.526113 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:19.526070 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39efdfe1-dfd2-40ef-a531-2cc2060bcbf1" path="/var/lib/kubelet/pods/39efdfe1-dfd2-40ef-a531-2cc2060bcbf1/volumes" Jul 21 14:26:24.577820 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:24.577762 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kx8d6"] Jul 21 14:26:24.578350 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:24.578025 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kx8d6" podUID="47c81784-acac-4c12-99ea-a2665a27b7d2" containerName="manager" containerID="cri-o://bd39cd36c24e0fd2f57742c4b5d35b30219fe01f963aba646a5a3e557160d059" gracePeriod=10 Jul 21 14:26:24.580223 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:24.580190 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kx8d6" Jul 21 14:26:24.847355 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:24.847329 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kx8d6" Jul 21 14:26:24.949828 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:24.949803 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/47c81784-acac-4c12-99ea-a2665a27b7d2-extensions-socket-volume\") pod \"47c81784-acac-4c12-99ea-a2665a27b7d2\" (UID: \"47c81784-acac-4c12-99ea-a2665a27b7d2\") " Jul 21 14:26:24.949974 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:24.949866 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5vd7d\" (UniqueName: \"kubernetes.io/projected/47c81784-acac-4c12-99ea-a2665a27b7d2-kube-api-access-5vd7d\") pod \"47c81784-acac-4c12-99ea-a2665a27b7d2\" (UID: \"47c81784-acac-4c12-99ea-a2665a27b7d2\") " Jul 21 14:26:24.950222 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:24.950199 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47c81784-acac-4c12-99ea-a2665a27b7d2-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "47c81784-acac-4c12-99ea-a2665a27b7d2" (UID: "47c81784-acac-4c12-99ea-a2665a27b7d2"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:26:24.951746 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:24.951725 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47c81784-acac-4c12-99ea-a2665a27b7d2-kube-api-access-5vd7d" (OuterVolumeSpecName: "kube-api-access-5vd7d") pod "47c81784-acac-4c12-99ea-a2665a27b7d2" (UID: "47c81784-acac-4c12-99ea-a2665a27b7d2"). InnerVolumeSpecName "kube-api-access-5vd7d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 14:26:25.050853 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:25.050829 2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/47c81784-acac-4c12-99ea-a2665a27b7d2-extensions-socket-volume\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:26:25.050853 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:25.050852 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5vd7d\" (UniqueName: \"kubernetes.io/projected/47c81784-acac-4c12-99ea-a2665a27b7d2-kube-api-access-5vd7d\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:26:25.450205 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:25.450169 2576 generic.go:356] "Generic (PLEG): container finished" podID="47c81784-acac-4c12-99ea-a2665a27b7d2" containerID="bd39cd36c24e0fd2f57742c4b5d35b30219fe01f963aba646a5a3e557160d059" exitCode=0 Jul 21 14:26:25.450383 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:25.450225 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kx8d6" Jul 21 14:26:25.450383 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:25.450257 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kx8d6" event={"ID":"47c81784-acac-4c12-99ea-a2665a27b7d2","Type":"ContainerDied","Data":"bd39cd36c24e0fd2f57742c4b5d35b30219fe01f963aba646a5a3e557160d059"} Jul 21 14:26:25.450383 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:25.450340 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kx8d6" event={"ID":"47c81784-acac-4c12-99ea-a2665a27b7d2","Type":"ContainerDied","Data":"fba69444dd65bedac3082793eb19369c1a1cecc096c8807411a4720f084ab146"} Jul 21 14:26:25.450383 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:25.450370 2576 scope.go:117] "RemoveContainer" containerID="bd39cd36c24e0fd2f57742c4b5d35b30219fe01f963aba646a5a3e557160d059" Jul 21 14:26:25.460071 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:25.460051 2576 scope.go:117] "RemoveContainer" containerID="bd39cd36c24e0fd2f57742c4b5d35b30219fe01f963aba646a5a3e557160d059" Jul 21 14:26:25.460328 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:26:25.460310 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd39cd36c24e0fd2f57742c4b5d35b30219fe01f963aba646a5a3e557160d059\": container with ID starting with bd39cd36c24e0fd2f57742c4b5d35b30219fe01f963aba646a5a3e557160d059 not found: ID does not exist" containerID="bd39cd36c24e0fd2f57742c4b5d35b30219fe01f963aba646a5a3e557160d059" Jul 21 14:26:25.460368 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:25.460338 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd39cd36c24e0fd2f57742c4b5d35b30219fe01f963aba646a5a3e557160d059"} err="failed to get container status \"bd39cd36c24e0fd2f57742c4b5d35b30219fe01f963aba646a5a3e557160d059\": rpc error: code = NotFound desc = could not find container \"bd39cd36c24e0fd2f57742c4b5d35b30219fe01f963aba646a5a3e557160d059\": container with ID starting with bd39cd36c24e0fd2f57742c4b5d35b30219fe01f963aba646a5a3e557160d059 not found: ID does not exist" Jul 21 14:26:25.484522 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:25.484493 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kx8d6"] Jul 21 14:26:25.486488 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:25.486469 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kx8d6"] Jul 21 14:26:25.525915 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:25.525890 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47c81784-acac-4c12-99ea-a2665a27b7d2" path="/var/lib/kubelet/pods/47c81784-acac-4c12-99ea-a2665a27b7d2/volumes" Jul 21 14:26:40.997481 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:40.997444 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-g9nb8"] Jul 21 14:26:40.997918 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:40.997794 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39efdfe1-dfd2-40ef-a531-2cc2060bcbf1" containerName="manager" Jul 21 14:26:40.997918 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:40.997811 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="39efdfe1-dfd2-40ef-a531-2cc2060bcbf1" containerName="manager" Jul 21 14:26:40.997918 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:40.997833 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47c81784-acac-4c12-99ea-a2665a27b7d2" containerName="manager" Jul 21 14:26:40.997918 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:40.997839 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="47c81784-acac-4c12-99ea-a2665a27b7d2" containerName="manager" Jul 21 14:26:40.997918 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:40.997902 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="39efdfe1-dfd2-40ef-a531-2cc2060bcbf1" containerName="manager" Jul 21 14:26:40.997918 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:40.997910 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="47c81784-acac-4c12-99ea-a2665a27b7d2" containerName="manager" Jul 21 14:26:41.002537 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:41.002520 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-g9nb8" Jul 21 14:26:41.005347 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:41.005325 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-9474t\"" Jul 21 14:26:41.012879 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:41.012856 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-g9nb8"] Jul 21 14:26:41.087016 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:41.086937 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c4551f83-1828-4d44-831b-fe84051b1654-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-g9nb8\" (UID: \"c4551f83-1828-4d44-831b-fe84051b1654\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-g9nb8" Jul 21 14:26:41.087016 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:41.087020 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c4551f83-1828-4d44-831b-fe84051b1654-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-g9nb8\" (UID: \"c4551f83-1828-4d44-831b-fe84051b1654\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-g9nb8" Jul 21 14:26:41.087385 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:41.087140 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c4551f83-1828-4d44-831b-fe84051b1654-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-g9nb8\" (UID: \"c4551f83-1828-4d44-831b-fe84051b1654\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-g9nb8" Jul 21 14:26:41.087385 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:41.087228 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2d95w\" (UniqueName: \"kubernetes.io/projected/c4551f83-1828-4d44-831b-fe84051b1654-kube-api-access-2d95w\") pod \"maas-default-gateway-openshift-default-5896d4dd49-g9nb8\" (UID: \"c4551f83-1828-4d44-831b-fe84051b1654\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-g9nb8" Jul 21 14:26:41.087385 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:41.087308 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c4551f83-1828-4d44-831b-fe84051b1654-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-g9nb8\" (UID: \"c4551f83-1828-4d44-831b-fe84051b1654\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-g9nb8" Jul 21 14:26:41.087385 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:41.087329 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c4551f83-1828-4d44-831b-fe84051b1654-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-g9nb8\" (UID: \"c4551f83-1828-4d44-831b-fe84051b1654\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-g9nb8" Jul 21 14:26:41.087385 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:41.087356 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4551f83-1828-4d44-831b-fe84051b1654-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-g9nb8\" (UID: \"c4551f83-1828-4d44-831b-fe84051b1654\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-g9nb8" Jul 21 14:26:41.087385 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:41.087377 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4551f83-1828-4d44-831b-fe84051b1654-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-g9nb8\" (UID: \"c4551f83-1828-4d44-831b-fe84051b1654\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-g9nb8" Jul 21 14:26:41.087814 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:41.087396 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c4551f83-1828-4d44-831b-fe84051b1654-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-g9nb8\" (UID: \"c4551f83-1828-4d44-831b-fe84051b1654\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-g9nb8" Jul 21 14:26:41.188737 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:41.188689 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c4551f83-1828-4d44-831b-fe84051b1654-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-g9nb8\" (UID: \"c4551f83-1828-4d44-831b-fe84051b1654\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-g9nb8" Jul 21 14:26:41.188737 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:41.188743 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c4551f83-1828-4d44-831b-fe84051b1654-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-g9nb8\" (UID: \"c4551f83-1828-4d44-831b-fe84051b1654\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-g9nb8" Jul 21 14:26:41.189069 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:41.188812 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2d95w\" (UniqueName: \"kubernetes.io/projected/c4551f83-1828-4d44-831b-fe84051b1654-kube-api-access-2d95w\") pod \"maas-default-gateway-openshift-default-5896d4dd49-g9nb8\" (UID: \"c4551f83-1828-4d44-831b-fe84051b1654\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-g9nb8" Jul 21 14:26:41.189069 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:41.188868 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c4551f83-1828-4d44-831b-fe84051b1654-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-g9nb8\" (UID: \"c4551f83-1828-4d44-831b-fe84051b1654\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-g9nb8" Jul 21 14:26:41.189069 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:41.188892 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c4551f83-1828-4d44-831b-fe84051b1654-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-g9nb8\" (UID: \"c4551f83-1828-4d44-831b-fe84051b1654\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-g9nb8" Jul 21 14:26:41.189069 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:41.188914 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4551f83-1828-4d44-831b-fe84051b1654-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-g9nb8\" (UID: \"c4551f83-1828-4d44-831b-fe84051b1654\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-g9nb8" Jul 21 14:26:41.189069 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:41.188974 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4551f83-1828-4d44-831b-fe84051b1654-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-g9nb8\" (UID: \"c4551f83-1828-4d44-831b-fe84051b1654\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-g9nb8" Jul 21 14:26:41.189069 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:41.188998 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c4551f83-1828-4d44-831b-fe84051b1654-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-g9nb8\" (UID: \"c4551f83-1828-4d44-831b-fe84051b1654\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-g9nb8" Jul 21 14:26:41.189336 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:41.189083 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c4551f83-1828-4d44-831b-fe84051b1654-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-g9nb8\" (UID: \"c4551f83-1828-4d44-831b-fe84051b1654\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-g9nb8" Jul 21 14:26:41.189522 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:41.189488 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c4551f83-1828-4d44-831b-fe84051b1654-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-g9nb8\" (UID: \"c4551f83-1828-4d44-831b-fe84051b1654\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-g9nb8" Jul 21 14:26:41.189618 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:41.189587 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c4551f83-1828-4d44-831b-fe84051b1654-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-g9nb8\" (UID: \"c4551f83-1828-4d44-831b-fe84051b1654\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-g9nb8" Jul 21 14:26:41.189681 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:41.189656 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4551f83-1828-4d44-831b-fe84051b1654-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-g9nb8\" (UID: \"c4551f83-1828-4d44-831b-fe84051b1654\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-g9nb8" Jul 21 14:26:41.189748 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:41.189715 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c4551f83-1828-4d44-831b-fe84051b1654-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-g9nb8\" (UID: \"c4551f83-1828-4d44-831b-fe84051b1654\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-g9nb8" Jul 21 14:26:41.189748 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:41.189731 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4551f83-1828-4d44-831b-fe84051b1654-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-g9nb8\" (UID: \"c4551f83-1828-4d44-831b-fe84051b1654\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-g9nb8" Jul 21 14:26:41.191925 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:41.191891 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c4551f83-1828-4d44-831b-fe84051b1654-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-g9nb8\" (UID: \"c4551f83-1828-4d44-831b-fe84051b1654\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-g9nb8" Jul 21 14:26:41.192098 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:41.192082 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c4551f83-1828-4d44-831b-fe84051b1654-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-g9nb8\" (UID: \"c4551f83-1828-4d44-831b-fe84051b1654\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-g9nb8" Jul 21 14:26:41.199762 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:41.199713 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c4551f83-1828-4d44-831b-fe84051b1654-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-g9nb8\" (UID: \"c4551f83-1828-4d44-831b-fe84051b1654\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-g9nb8" Jul 21 14:26:41.200053 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:41.200027 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2d95w\" (UniqueName: \"kubernetes.io/projected/c4551f83-1828-4d44-831b-fe84051b1654-kube-api-access-2d95w\") pod \"maas-default-gateway-openshift-default-5896d4dd49-g9nb8\" (UID: \"c4551f83-1828-4d44-831b-fe84051b1654\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-g9nb8" Jul 21 14:26:41.313611 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:41.313469 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-g9nb8" Jul 21 14:26:41.493886 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:41.493843 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-g9nb8"] Jul 21 14:26:41.497396 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:26:41.497342 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4551f83_1828_4d44_831b_fe84051b1654.slice/crio-d6fe57becd20a886fa29e05343ee635f15e0a081959f3e11ee663fb7fbe2c238 WatchSource:0}: Error finding container d6fe57becd20a886fa29e05343ee635f15e0a081959f3e11ee663fb7fbe2c238: Status 404 returned error can't find the container with id d6fe57becd20a886fa29e05343ee635f15e0a081959f3e11ee663fb7fbe2c238 Jul 21 14:26:41.500299 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:41.500247 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:26:41.500493 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:41.500340 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:26:41.500493 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:41.500375 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:26:41.549211 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:41.549161 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-g9nb8" event={"ID":"c4551f83-1828-4d44-831b-fe84051b1654","Type":"ContainerStarted","Data":"d6fe57becd20a886fa29e05343ee635f15e0a081959f3e11ee663fb7fbe2c238"} Jul 21 14:26:42.558153 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:42.558105 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-g9nb8" event={"ID":"c4551f83-1828-4d44-831b-fe84051b1654","Type":"ContainerStarted","Data":"9817999f35f5698a3f363486555ddf4596aa72f4cb7457432c2dfa46baef23f1"} Jul 21 14:26:42.585166 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:42.585053 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-g9nb8" podStartSLOduration=2.585029104 podStartE2EDuration="2.585029104s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:26:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:26:42.582022729 +0000 UTC m=+529.599926358" watchObservedRunningTime="2026-07-21 14:26:42.585029104 +0000 UTC m=+529.602932679" Jul 21 14:26:43.314221 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:43.314159 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-g9nb8" Jul 21 14:26:43.320772 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:43.320734 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-g9nb8" Jul 21 14:26:43.564970 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:43.564819 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-g9nb8" Jul 21 14:26:43.566987 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:26:43.566936 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-g9nb8" Jul 21 14:28:10.526262 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:28:10.526215 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-jlwrw"] Jul 21 14:28:10.530238 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:28:10.530195 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-jlwrw" Jul 21 14:28:10.532988 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:28:10.532954 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 21 14:28:10.533185 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:28:10.533034 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-kbp5p\"" Jul 21 14:28:10.546755 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:28:10.546692 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-jlwrw"] Jul 21 14:28:10.575487 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:28:10.575443 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d95tg\" (UniqueName: \"kubernetes.io/projected/e6b03f14-45dd-425e-91d2-f225435564f7-kube-api-access-d95tg\") pod \"payload-pre-processing-7677b774bb-jlwrw\" (UID: \"e6b03f14-45dd-425e-91d2-f225435564f7\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-jlwrw" Jul 21 14:28:10.575707 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:28:10.575523 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e6b03f14-45dd-425e-91d2-f225435564f7-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-jlwrw\" (UID: \"e6b03f14-45dd-425e-91d2-f225435564f7\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-jlwrw" Jul 21 14:28:10.676298 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:28:10.676263 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e6b03f14-45dd-425e-91d2-f225435564f7-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-jlwrw\" (UID: \"e6b03f14-45dd-425e-91d2-f225435564f7\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-jlwrw" Jul 21 14:28:10.676516 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:28:10.676384 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d95tg\" (UniqueName: \"kubernetes.io/projected/e6b03f14-45dd-425e-91d2-f225435564f7-kube-api-access-d95tg\") pod \"payload-pre-processing-7677b774bb-jlwrw\" (UID: \"e6b03f14-45dd-425e-91d2-f225435564f7\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-jlwrw" Jul 21 14:28:10.677035 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:28:10.677015 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e6b03f14-45dd-425e-91d2-f225435564f7-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-jlwrw\" (UID: \"e6b03f14-45dd-425e-91d2-f225435564f7\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-jlwrw" Jul 21 14:28:10.695982 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:28:10.695944 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d95tg\" (UniqueName: \"kubernetes.io/projected/e6b03f14-45dd-425e-91d2-f225435564f7-kube-api-access-d95tg\") pod \"payload-pre-processing-7677b774bb-jlwrw\" (UID: \"e6b03f14-45dd-425e-91d2-f225435564f7\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-jlwrw" Jul 21 14:28:10.844045 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:28:10.843932 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-jlwrw" Jul 21 14:28:11.002016 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:28:11.001974 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-jlwrw"] Jul 21 14:28:11.004272 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:28:11.004231 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6b03f14_45dd_425e_91d2_f225435564f7.slice/crio-0606fbcbcf17ea92b5b00cb91e4f9204cc5fdd605c95b10d46c06d0644dd3eb3 WatchSource:0}: Error finding container 0606fbcbcf17ea92b5b00cb91e4f9204cc5fdd605c95b10d46c06d0644dd3eb3: Status 404 returned error can't find the container with id 0606fbcbcf17ea92b5b00cb91e4f9204cc5fdd605c95b10d46c06d0644dd3eb3 Jul 21 14:28:11.006583 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:28:11.006560 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 21 14:28:11.109816 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:28:11.109653 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-jlwrw" event={"ID":"e6b03f14-45dd-425e-91d2-f225435564f7","Type":"ContainerStarted","Data":"0606fbcbcf17ea92b5b00cb91e4f9204cc5fdd605c95b10d46c06d0644dd3eb3"} Jul 21 14:28:13.137952 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:28:13.137816 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-jlwrw" event={"ID":"e6b03f14-45dd-425e-91d2-f225435564f7","Type":"ContainerStarted","Data":"4281c1b59ec29131fb983dc475a2ecf3948be77df8d9fffeae99263acdd3b801"} Jul 21 14:28:13.137952 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:28:13.137937 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-jlwrw" Jul 21 14:28:13.160455 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:28:13.160342 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-jlwrw" podStartSLOduration=1.300541735 podStartE2EDuration="3.160311256s" totalImagesPullingTime="1.859769521s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:28:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:28:13.156985104 +0000 UTC m=+620.174888678" watchObservedRunningTime="2026-07-21 14:28:13.160311256 +0000 UTC m=+620.178214841" Jul 21 14:28:19.185521 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:28:19.185362 2576 generic.go:356] "Generic (PLEG): container finished" podID="c4551f83-1828-4d44-831b-fe84051b1654" containerID="9817999f35f5698a3f363486555ddf4596aa72f4cb7457432c2dfa46baef23f1" exitCode=0 Jul 21 14:28:19.185521 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:28:19.185449 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-g9nb8" event={"ID":"c4551f83-1828-4d44-831b-fe84051b1654","Type":"ContainerDied","Data":"9817999f35f5698a3f363486555ddf4596aa72f4cb7457432c2dfa46baef23f1"} Jul 21 14:28:19.186327 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:28:19.186146 2576 scope.go:117] "RemoveContainer" containerID="9817999f35f5698a3f363486555ddf4596aa72f4cb7457432c2dfa46baef23f1" Jul 21 14:28:19.188025 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:28:19.187978 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:28:19.188138 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:28:19.188093 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:28:19.188175 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:28:19.188135 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:28:20.208800 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:28:20.205553 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-g9nb8" event={"ID":"c4551f83-1828-4d44-831b-fe84051b1654","Type":"ContainerStarted","Data":"533749b04694cf5369477fe2048749344d379a5969be6d553a00b71d82eafe58"} Jul 21 14:28:20.314066 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:28:20.314009 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-g9nb8" Jul 21 14:28:20.314336 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:28:20.314186 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-g9nb8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Jul 21 14:28:20.314336 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:28:20.314241 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-g9nb8" podUID="c4551f83-1828-4d44-831b-fe84051b1654" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Jul 21 14:28:21.314950 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:28:21.314897 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-g9nb8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Jul 21 14:28:21.315815 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:28:21.315718 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-g9nb8" podUID="c4551f83-1828-4d44-831b-fe84051b1654" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Jul 21 14:28:22.315052 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:28:22.314991 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-g9nb8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Jul 21 14:28:22.315925 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:28:22.315870 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-g9nb8" podUID="c4551f83-1828-4d44-831b-fe84051b1654" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Jul 21 14:28:23.315103 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:28:23.315033 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-g9nb8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Jul 21 14:28:23.315842 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:28:23.315135 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-g9nb8" podUID="c4551f83-1828-4d44-831b-fe84051b1654" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Jul 21 14:28:24.153338 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:28:24.153272 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-7677b774bb-jlwrw" podUID="e6b03f14-45dd-425e-91d2-f225435564f7" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.133.0.38:9004: connect: connection refused" Jul 21 14:28:24.314440 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:28:24.314395 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-g9nb8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Jul 21 14:28:24.314662 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:28:24.314465 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-g9nb8" podUID="c4551f83-1828-4d44-831b-fe84051b1654" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Jul 21 14:28:25.319341 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:28:25.319293 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-g9nb8" Jul 21 14:28:25.319868 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:28:25.319839 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-g9nb8" Jul 21 14:28:25.320772 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:28:25.320744 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-g9nb8" Jul 21 14:28:34.152628 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:28:34.152585 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-jlwrw" Jul 21 14:29:00.583941 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:00.583747 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gtz9r"] Jul 21 14:29:00.588279 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:00.588235 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gtz9r" Jul 21 14:29:00.592576 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:00.592537 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-5rcx2\"" Jul 21 14:29:00.592848 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:00.592537 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 21 14:29:00.592848 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:00.592537 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 21 14:29:00.592848 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:00.592537 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 21 14:29:00.598579 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:00.598236 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gtz9r"] Jul 21 14:29:00.697381 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:00.697327 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21137ad7-e3d7-4898-ba72-5ecc2e63f9cf-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gtz9r\" (UID: \"21137ad7-e3d7-4898-ba72-5ecc2e63f9cf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gtz9r" Jul 21 14:29:00.697381 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:00.697374 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/21137ad7-e3d7-4898-ba72-5ecc2e63f9cf-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gtz9r\" (UID: \"21137ad7-e3d7-4898-ba72-5ecc2e63f9cf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gtz9r" Jul 21 14:29:00.697662 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:00.697494 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/21137ad7-e3d7-4898-ba72-5ecc2e63f9cf-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gtz9r\" (UID: \"21137ad7-e3d7-4898-ba72-5ecc2e63f9cf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gtz9r" Jul 21 14:29:00.697662 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:00.697531 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21137ad7-e3d7-4898-ba72-5ecc2e63f9cf-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gtz9r\" (UID: \"21137ad7-e3d7-4898-ba72-5ecc2e63f9cf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gtz9r" Jul 21 14:29:00.697756 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:00.697676 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/21137ad7-e3d7-4898-ba72-5ecc2e63f9cf-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gtz9r\" (UID: \"21137ad7-e3d7-4898-ba72-5ecc2e63f9cf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gtz9r" Jul 21 14:29:00.697827 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:00.697754 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkxmd\" (UniqueName: \"kubernetes.io/projected/21137ad7-e3d7-4898-ba72-5ecc2e63f9cf-kube-api-access-hkxmd\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gtz9r\" (UID: \"21137ad7-e3d7-4898-ba72-5ecc2e63f9cf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gtz9r" Jul 21 14:29:00.799122 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:00.799068 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21137ad7-e3d7-4898-ba72-5ecc2e63f9cf-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gtz9r\" (UID: \"21137ad7-e3d7-4898-ba72-5ecc2e63f9cf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gtz9r" Jul 21 14:29:00.799122 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:00.799117 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/21137ad7-e3d7-4898-ba72-5ecc2e63f9cf-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gtz9r\" (UID: \"21137ad7-e3d7-4898-ba72-5ecc2e63f9cf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gtz9r" Jul 21 14:29:00.799382 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:00.799164 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/21137ad7-e3d7-4898-ba72-5ecc2e63f9cf-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gtz9r\" (UID: \"21137ad7-e3d7-4898-ba72-5ecc2e63f9cf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gtz9r" Jul 21 14:29:00.799382 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:00.799184 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21137ad7-e3d7-4898-ba72-5ecc2e63f9cf-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gtz9r\" (UID: \"21137ad7-e3d7-4898-ba72-5ecc2e63f9cf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gtz9r" Jul 21 14:29:00.799382 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:00.799256 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/21137ad7-e3d7-4898-ba72-5ecc2e63f9cf-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gtz9r\" (UID: \"21137ad7-e3d7-4898-ba72-5ecc2e63f9cf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gtz9r" Jul 21 14:29:00.799382 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:00.799312 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkxmd\" (UniqueName: \"kubernetes.io/projected/21137ad7-e3d7-4898-ba72-5ecc2e63f9cf-kube-api-access-hkxmd\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gtz9r\" (UID: \"21137ad7-e3d7-4898-ba72-5ecc2e63f9cf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gtz9r" Jul 21 14:29:00.799586 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:00.799567 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21137ad7-e3d7-4898-ba72-5ecc2e63f9cf-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gtz9r\" (UID: \"21137ad7-e3d7-4898-ba72-5ecc2e63f9cf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gtz9r" Jul 21 14:29:00.799658 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:00.799632 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/21137ad7-e3d7-4898-ba72-5ecc2e63f9cf-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gtz9r\" (UID: \"21137ad7-e3d7-4898-ba72-5ecc2e63f9cf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gtz9r" Jul 21 14:29:00.799751 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:00.799731 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/21137ad7-e3d7-4898-ba72-5ecc2e63f9cf-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gtz9r\" (UID: \"21137ad7-e3d7-4898-ba72-5ecc2e63f9cf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gtz9r" Jul 21 14:29:00.802473 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:00.802434 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/21137ad7-e3d7-4898-ba72-5ecc2e63f9cf-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gtz9r\" (UID: \"21137ad7-e3d7-4898-ba72-5ecc2e63f9cf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gtz9r" Jul 21 14:29:00.802616 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:00.802595 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21137ad7-e3d7-4898-ba72-5ecc2e63f9cf-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gtz9r\" (UID: \"21137ad7-e3d7-4898-ba72-5ecc2e63f9cf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gtz9r" Jul 21 14:29:00.809895 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:00.809735 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkxmd\" (UniqueName: \"kubernetes.io/projected/21137ad7-e3d7-4898-ba72-5ecc2e63f9cf-kube-api-access-hkxmd\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gtz9r\" (UID: \"21137ad7-e3d7-4898-ba72-5ecc2e63f9cf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gtz9r" Jul 21 14:29:00.903622 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:00.903477 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gtz9r" Jul 21 14:29:01.079340 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:01.079311 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gtz9r"] Jul 21 14:29:01.080926 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:29:01.080901 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21137ad7_e3d7_4898_ba72_5ecc2e63f9cf.slice/crio-f01cf6d1a3dcaabf7b4a350ab14d02b10bf1dea716d05d8135a6f9c5468c6b0b WatchSource:0}: Error finding container f01cf6d1a3dcaabf7b4a350ab14d02b10bf1dea716d05d8135a6f9c5468c6b0b: Status 404 returned error can't find the container with id f01cf6d1a3dcaabf7b4a350ab14d02b10bf1dea716d05d8135a6f9c5468c6b0b Jul 21 14:29:01.486618 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:01.486531 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gtz9r" event={"ID":"21137ad7-e3d7-4898-ba72-5ecc2e63f9cf","Type":"ContainerStarted","Data":"f01cf6d1a3dcaabf7b4a350ab14d02b10bf1dea716d05d8135a6f9c5468c6b0b"} Jul 21 14:29:03.503329 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:03.503262 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gtz9r" event={"ID":"21137ad7-e3d7-4898-ba72-5ecc2e63f9cf","Type":"ContainerStarted","Data":"94960a7486a47a56809aae13fc2495cdb556e104429be1d8420973ad7ef8aa10"} Jul 21 14:29:03.525357 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:03.525277 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gtz9r" podStartSLOduration=2.015828515 podStartE2EDuration="3.525252698s" totalImagesPullingTime="1.509424183s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:29:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:29:03.522920706 +0000 UTC m=+670.540824284" watchObservedRunningTime="2026-07-21 14:29:03.525252698 +0000 UTC m=+670.543156272" Jul 21 14:29:10.904071 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:10.904005 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gtz9r" Jul 21 14:29:10.904774 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:10.904106 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gtz9r" Jul 21 14:29:10.918503 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:10.918472 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gtz9r" Jul 21 14:29:11.564005 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:11.563973 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gtz9r" Jul 21 14:29:27.576757 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:27.576707 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-q9lhj"] Jul 21 14:29:27.583888 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:27.583850 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q9lhj" Jul 21 14:29:27.587104 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:27.587059 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 21 14:29:27.598841 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:27.598797 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-q9lhj"] Jul 21 14:29:27.681707 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:27.681661 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c585958-9593-40e3-a110-05e98c328232-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q9lhj\" (UID: \"6c585958-9593-40e3-a110-05e98c328232\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q9lhj" Jul 21 14:29:27.681940 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:27.681726 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6c585958-9593-40e3-a110-05e98c328232-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q9lhj\" (UID: \"6c585958-9593-40e3-a110-05e98c328232\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q9lhj" Jul 21 14:29:27.681940 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:27.681764 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c585958-9593-40e3-a110-05e98c328232-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q9lhj\" (UID: \"6c585958-9593-40e3-a110-05e98c328232\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q9lhj" Jul 21 14:29:27.681940 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:27.681841 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c585958-9593-40e3-a110-05e98c328232-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q9lhj\" (UID: \"6c585958-9593-40e3-a110-05e98c328232\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q9lhj" Jul 21 14:29:27.681940 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:27.681862 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rpsv\" (UniqueName: \"kubernetes.io/projected/6c585958-9593-40e3-a110-05e98c328232-kube-api-access-4rpsv\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q9lhj\" (UID: \"6c585958-9593-40e3-a110-05e98c328232\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q9lhj" Jul 21 14:29:27.681940 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:27.681898 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c585958-9593-40e3-a110-05e98c328232-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q9lhj\" (UID: \"6c585958-9593-40e3-a110-05e98c328232\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q9lhj" Jul 21 14:29:27.783393 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:27.783335 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6c585958-9593-40e3-a110-05e98c328232-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q9lhj\" (UID: \"6c585958-9593-40e3-a110-05e98c328232\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q9lhj" Jul 21 14:29:27.783393 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:27.783396 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c585958-9593-40e3-a110-05e98c328232-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q9lhj\" (UID: \"6c585958-9593-40e3-a110-05e98c328232\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q9lhj" Jul 21 14:29:27.783712 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:27.783454 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c585958-9593-40e3-a110-05e98c328232-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q9lhj\" (UID: \"6c585958-9593-40e3-a110-05e98c328232\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q9lhj" Jul 21 14:29:27.783712 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:27.783477 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rpsv\" (UniqueName: \"kubernetes.io/projected/6c585958-9593-40e3-a110-05e98c328232-kube-api-access-4rpsv\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q9lhj\" (UID: \"6c585958-9593-40e3-a110-05e98c328232\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q9lhj" Jul 21 14:29:27.783712 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:27.783527 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c585958-9593-40e3-a110-05e98c328232-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q9lhj\" (UID: \"6c585958-9593-40e3-a110-05e98c328232\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q9lhj" Jul 21 14:29:27.783712 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:27.783634 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c585958-9593-40e3-a110-05e98c328232-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q9lhj\" (UID: \"6c585958-9593-40e3-a110-05e98c328232\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q9lhj" Jul 21 14:29:27.783973 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:27.783941 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6c585958-9593-40e3-a110-05e98c328232-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q9lhj\" (UID: \"6c585958-9593-40e3-a110-05e98c328232\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q9lhj" Jul 21 14:29:27.784030 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:27.783981 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c585958-9593-40e3-a110-05e98c328232-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q9lhj\" (UID: \"6c585958-9593-40e3-a110-05e98c328232\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q9lhj" Jul 21 14:29:27.784141 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:27.784114 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c585958-9593-40e3-a110-05e98c328232-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q9lhj\" (UID: \"6c585958-9593-40e3-a110-05e98c328232\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q9lhj" Jul 21 14:29:27.786271 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:27.786230 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c585958-9593-40e3-a110-05e98c328232-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q9lhj\" (UID: \"6c585958-9593-40e3-a110-05e98c328232\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q9lhj" Jul 21 14:29:27.786565 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:27.786545 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c585958-9593-40e3-a110-05e98c328232-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q9lhj\" (UID: \"6c585958-9593-40e3-a110-05e98c328232\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q9lhj" Jul 21 14:29:27.795638 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:27.795605 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rpsv\" (UniqueName: \"kubernetes.io/projected/6c585958-9593-40e3-a110-05e98c328232-kube-api-access-4rpsv\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q9lhj\" (UID: \"6c585958-9593-40e3-a110-05e98c328232\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q9lhj" Jul 21 14:29:27.898237 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:27.898124 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q9lhj" Jul 21 14:29:28.075101 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:28.075068 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-q9lhj"] Jul 21 14:29:28.076758 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:29:28.076715 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c585958_9593_40e3_a110_05e98c328232.slice/crio-ccdc24b2d460d2a3ae34052220cf7406652f47539fdeb5182c076a42dbc810f1 WatchSource:0}: Error finding container ccdc24b2d460d2a3ae34052220cf7406652f47539fdeb5182c076a42dbc810f1: Status 404 returned error can't find the container with id ccdc24b2d460d2a3ae34052220cf7406652f47539fdeb5182c076a42dbc810f1 Jul 21 14:29:28.657301 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:28.657167 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q9lhj" event={"ID":"6c585958-9593-40e3-a110-05e98c328232","Type":"ContainerStarted","Data":"e0e9218626892d67884ce6db7e4eeeec9d3c55c5c74d94a086f422a0a74b70ca"} Jul 21 14:29:28.657301 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:28.657240 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q9lhj" event={"ID":"6c585958-9593-40e3-a110-05e98c328232","Type":"ContainerStarted","Data":"ccdc24b2d460d2a3ae34052220cf7406652f47539fdeb5182c076a42dbc810f1"} Jul 21 14:29:28.682521 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:28.682415 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q9lhj" podStartSLOduration=1.46631599 podStartE2EDuration="1.682388264s" totalImagesPullingTime="216.072274ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:29:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:29:28.6784834 +0000 UTC m=+695.696386993" watchObservedRunningTime="2026-07-21 14:29:28.682388264 +0000 UTC m=+695.700291837" Jul 21 14:29:37.898586 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:37.898496 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q9lhj" Jul 21 14:29:37.899350 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:37.898683 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q9lhj" Jul 21 14:29:37.913181 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:37.913131 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q9lhj" Jul 21 14:29:38.736335 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:38.736293 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q9lhj" Jul 21 14:29:52.341757 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:52.341706 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-2j54x"] Jul 21 14:29:52.346060 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:52.346024 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2j54x" Jul 21 14:29:52.349235 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:52.349192 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 21 14:29:52.356005 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:52.355960 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-2j54x"] Jul 21 14:29:52.429445 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:52.429383 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/713b7a8c-d6a3-453f-adc3-184c13238b61-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2j54x\" (UID: \"713b7a8c-d6a3-453f-adc3-184c13238b61\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2j54x" Jul 21 14:29:52.429717 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:52.429471 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9fbv\" (UniqueName: \"kubernetes.io/projected/713b7a8c-d6a3-453f-adc3-184c13238b61-kube-api-access-b9fbv\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2j54x\" (UID: \"713b7a8c-d6a3-453f-adc3-184c13238b61\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2j54x" Jul 21 14:29:52.429717 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:52.429505 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/713b7a8c-d6a3-453f-adc3-184c13238b61-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2j54x\" (UID: \"713b7a8c-d6a3-453f-adc3-184c13238b61\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2j54x" Jul 21 14:29:52.429717 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:52.429528 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/713b7a8c-d6a3-453f-adc3-184c13238b61-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2j54x\" (UID: \"713b7a8c-d6a3-453f-adc3-184c13238b61\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2j54x" Jul 21 14:29:52.429717 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:52.429604 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/713b7a8c-d6a3-453f-adc3-184c13238b61-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2j54x\" (UID: \"713b7a8c-d6a3-453f-adc3-184c13238b61\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2j54x" Jul 21 14:29:52.429717 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:52.429645 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/713b7a8c-d6a3-453f-adc3-184c13238b61-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2j54x\" (UID: \"713b7a8c-d6a3-453f-adc3-184c13238b61\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2j54x" Jul 21 14:29:52.530194 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:52.530136 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9fbv\" (UniqueName: \"kubernetes.io/projected/713b7a8c-d6a3-453f-adc3-184c13238b61-kube-api-access-b9fbv\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2j54x\" (UID: \"713b7a8c-d6a3-453f-adc3-184c13238b61\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2j54x" Jul 21 14:29:52.530194 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:52.530203 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/713b7a8c-d6a3-453f-adc3-184c13238b61-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2j54x\" (UID: \"713b7a8c-d6a3-453f-adc3-184c13238b61\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2j54x" Jul 21 14:29:52.530489 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:52.530228 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/713b7a8c-d6a3-453f-adc3-184c13238b61-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2j54x\" (UID: \"713b7a8c-d6a3-453f-adc3-184c13238b61\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2j54x" Jul 21 14:29:52.530489 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:52.530257 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/713b7a8c-d6a3-453f-adc3-184c13238b61-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2j54x\" (UID: \"713b7a8c-d6a3-453f-adc3-184c13238b61\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2j54x" Jul 21 14:29:52.530489 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:52.530298 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/713b7a8c-d6a3-453f-adc3-184c13238b61-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2j54x\" (UID: \"713b7a8c-d6a3-453f-adc3-184c13238b61\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2j54x" Jul 21 14:29:52.530489 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:52.530371 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/713b7a8c-d6a3-453f-adc3-184c13238b61-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2j54x\" (UID: \"713b7a8c-d6a3-453f-adc3-184c13238b61\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2j54x" Jul 21 14:29:52.530831 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:52.530753 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/713b7a8c-d6a3-453f-adc3-184c13238b61-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2j54x\" (UID: \"713b7a8c-d6a3-453f-adc3-184c13238b61\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2j54x" Jul 21 14:29:52.530939 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:52.530843 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/713b7a8c-d6a3-453f-adc3-184c13238b61-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2j54x\" (UID: \"713b7a8c-d6a3-453f-adc3-184c13238b61\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2j54x" Jul 21 14:29:52.530939 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:52.530863 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/713b7a8c-d6a3-453f-adc3-184c13238b61-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2j54x\" (UID: \"713b7a8c-d6a3-453f-adc3-184c13238b61\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2j54x" Jul 21 14:29:52.533266 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:52.533230 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/713b7a8c-d6a3-453f-adc3-184c13238b61-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2j54x\" (UID: \"713b7a8c-d6a3-453f-adc3-184c13238b61\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2j54x" Jul 21 14:29:52.533429 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:52.533409 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/713b7a8c-d6a3-453f-adc3-184c13238b61-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2j54x\" (UID: \"713b7a8c-d6a3-453f-adc3-184c13238b61\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2j54x" Jul 21 14:29:52.539741 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:52.539701 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9fbv\" (UniqueName: \"kubernetes.io/projected/713b7a8c-d6a3-453f-adc3-184c13238b61-kube-api-access-b9fbv\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2j54x\" (UID: \"713b7a8c-d6a3-453f-adc3-184c13238b61\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2j54x" Jul 21 14:29:52.663930 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:52.663752 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2j54x" Jul 21 14:29:52.829250 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:52.829224 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-2j54x"] Jul 21 14:29:52.831136 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:29:52.831105 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod713b7a8c_d6a3_453f_adc3_184c13238b61.slice/crio-99ac2be82647174b34a231ae252f912e073b234af4a357c01737b6ee7ee5d76a WatchSource:0}: Error finding container 99ac2be82647174b34a231ae252f912e073b234af4a357c01737b6ee7ee5d76a: Status 404 returned error can't find the container with id 99ac2be82647174b34a231ae252f912e073b234af4a357c01737b6ee7ee5d76a Jul 21 14:29:53.828377 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:53.828317 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2j54x" event={"ID":"713b7a8c-d6a3-453f-adc3-184c13238b61","Type":"ContainerStarted","Data":"a75371ebf022271db089699c193216dcfe1a17195212687f3817e8cd82d7ee65"} Jul 21 14:29:53.828985 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:53.828444 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2j54x" event={"ID":"713b7a8c-d6a3-453f-adc3-184c13238b61","Type":"ContainerStarted","Data":"99ac2be82647174b34a231ae252f912e073b234af4a357c01737b6ee7ee5d76a"} Jul 21 14:29:53.851940 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:29:53.851858 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2j54x" podStartSLOduration=1.427927577 podStartE2EDuration="1.851831174s" totalImagesPullingTime="423.903597ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:29:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:29:53.849407326 +0000 UTC m=+720.867310902" watchObservedRunningTime="2026-07-21 14:29:53.851831174 +0000 UTC m=+720.869734747" Jul 21 14:30:02.664431 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:30:02.664397 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2j54x" Jul 21 14:30:02.664856 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:30:02.664465 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2j54x" Jul 21 14:30:02.676908 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:30:02.676888 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2j54x" Jul 21 14:30:02.897662 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:30:02.897630 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2j54x" Jul 21 14:45:59.411653 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:45:59.411621 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8"] Jul 21 14:45:59.415084 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:45:59.415065 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8" Jul 21 14:45:59.417980 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:45:59.417949 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-78a7b505-openshift-default-dockercfg-pszqn\"" Jul 21 14:45:59.428254 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:45:59.428233 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8"] Jul 21 14:45:59.442729 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:45:59.442709 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24-workload-socket\") pod \"e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8\" (UID: \"7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24\") " pod="openshift-ingress/e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8" Jul 21 14:45:59.442854 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:45:59.442736 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nkp5\" (UniqueName: \"kubernetes.io/projected/7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24-kube-api-access-2nkp5\") pod \"e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8\" (UID: \"7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24\") " pod="openshift-ingress/e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8" Jul 21 14:45:59.442854 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:45:59.442800 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24-workload-certs\") pod \"e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8\" (UID: \"7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24\") " pod="openshift-ingress/e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8" Jul 21 14:45:59.442854 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:45:59.442840 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24-istio-token\") pod \"e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8\" (UID: \"7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24\") " pod="openshift-ingress/e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8" Jul 21 14:45:59.442970 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:45:59.442866 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24-istio-envoy\") pod \"e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8\" (UID: \"7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24\") " pod="openshift-ingress/e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8" Jul 21 14:45:59.442970 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:45:59.442889 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24-istio-data\") pod \"e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8\" (UID: \"7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24\") " pod="openshift-ingress/e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8" Jul 21 14:45:59.442970 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:45:59.442911 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24-credential-socket\") pod \"e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8\" (UID: \"7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24\") " pod="openshift-ingress/e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8" Jul 21 14:45:59.442970 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:45:59.442933 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24-istio-podinfo\") pod \"e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8\" (UID: \"7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24\") " pod="openshift-ingress/e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8" Jul 21 14:45:59.443096 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:45:59.442974 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24-istiod-ca-cert\") pod \"e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8\" (UID: \"7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24\") " pod="openshift-ingress/e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8" Jul 21 14:45:59.543577 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:45:59.543540 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24-istio-token\") pod \"e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8\" (UID: \"7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24\") " pod="openshift-ingress/e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8" Jul 21 14:45:59.543577 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:45:59.543580 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24-istio-envoy\") pod \"e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8\" (UID: \"7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24\") " pod="openshift-ingress/e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8" Jul 21 14:45:59.543867 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:45:59.543624 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24-istio-data\") pod \"e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8\" (UID: \"7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24\") " pod="openshift-ingress/e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8" Jul 21 14:45:59.543867 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:45:59.543659 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24-credential-socket\") pod \"e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8\" (UID: \"7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24\") " pod="openshift-ingress/e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8" Jul 21 14:45:59.543867 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:45:59.543686 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24-istio-podinfo\") pod \"e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8\" (UID: \"7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24\") " pod="openshift-ingress/e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8" Jul 21 14:45:59.543867 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:45:59.543740 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24-istiod-ca-cert\") pod \"e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8\" (UID: \"7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24\") " pod="openshift-ingress/e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8" Jul 21 14:45:59.544089 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:45:59.544067 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24-credential-socket\") pod \"e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8\" (UID: \"7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24\") " pod="openshift-ingress/e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8" Jul 21 14:45:59.544149 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:45:59.544091 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24-workload-socket\") pod \"e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8\" (UID: \"7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24\") " pod="openshift-ingress/e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8" Jul 21 14:45:59.544149 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:45:59.544128 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nkp5\" (UniqueName: \"kubernetes.io/projected/7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24-kube-api-access-2nkp5\") pod \"e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8\" (UID: \"7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24\") " pod="openshift-ingress/e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8" Jul 21 14:45:59.544250 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:45:59.544140 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24-istio-data\") pod \"e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8\" (UID: \"7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24\") " pod="openshift-ingress/e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8" Jul 21 14:45:59.544250 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:45:59.544221 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24-workload-certs\") pod \"e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8\" (UID: \"7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24\") " pod="openshift-ingress/e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8" Jul 21 14:45:59.544388 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:45:59.544356 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24-workload-socket\") pod \"e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8\" (UID: \"7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24\") " pod="openshift-ingress/e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8" Jul 21 14:45:59.544561 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:45:59.544535 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24-istiod-ca-cert\") pod \"e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8\" (UID: \"7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24\") " pod="openshift-ingress/e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8" Jul 21 14:45:59.544628 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:45:59.544549 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24-workload-certs\") pod \"e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8\" (UID: \"7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24\") " pod="openshift-ingress/e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8" Jul 21 14:45:59.545933 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:45:59.545914 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24-istio-envoy\") pod \"e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8\" (UID: \"7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24\") " pod="openshift-ingress/e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8" Jul 21 14:45:59.546186 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:45:59.546165 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24-istio-podinfo\") pod \"e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8\" (UID: \"7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24\") " pod="openshift-ingress/e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8" Jul 21 14:45:59.558456 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:45:59.558424 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nkp5\" (UniqueName: \"kubernetes.io/projected/7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24-kube-api-access-2nkp5\") pod \"e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8\" (UID: \"7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24\") " pod="openshift-ingress/e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8" Jul 21 14:45:59.560928 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:45:59.560901 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24-istio-token\") pod \"e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8\" (UID: \"7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24\") " pod="openshift-ingress/e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8" Jul 21 14:45:59.726445 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:45:59.726383 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8" Jul 21 14:45:59.865882 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:45:59.865859 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8"] Jul 21 14:45:59.866968 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:45:59.866942 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f9c2bb7_fd65_44f0_85bc_34a4ebcbaa24.slice/crio-9d6f36c9320c923cdc74c938f1cb0e4e353e47ccad2e4117f39eb94726871a36 WatchSource:0}: Error finding container 9d6f36c9320c923cdc74c938f1cb0e4e353e47ccad2e4117f39eb94726871a36: Status 404 returned error can't find the container with id 9d6f36c9320c923cdc74c938f1cb0e4e353e47ccad2e4117f39eb94726871a36 Jul 21 14:45:59.869154 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:45:59.869118 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:45:59.869239 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:45:59.869183 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:45:59.869239 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:45:59.869211 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:46:00.429811 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:00.429760 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8" event={"ID":"7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24","Type":"ContainerStarted","Data":"ddeaf25ce5d17b28216487a5a66e505eec1d980167bea97e734bafe1ee795503"} Jul 21 14:46:00.430275 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:00.429827 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8" event={"ID":"7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24","Type":"ContainerStarted","Data":"9d6f36c9320c923cdc74c938f1cb0e4e353e47ccad2e4117f39eb94726871a36"} Jul 21 14:46:00.457872 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:00.457826 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8" podStartSLOduration=1.457810659 podStartE2EDuration="1.457810659s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:45:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:46:00.45657403 +0000 UTC m=+1687.474477605" watchObservedRunningTime="2026-07-21 14:46:00.457810659 +0000 UTC m=+1687.475714232" Jul 21 14:46:00.727112 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:00.727041 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8" Jul 21 14:46:00.731593 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:00.731570 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8" Jul 21 14:46:01.435378 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:01.435343 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8" Jul 21 14:46:01.436348 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:01.436331 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8" Jul 21 14:46:17.477972 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:17.477927 2576 patch_prober.go:28] interesting pod/e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 21 14:46:17.478498 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:17.478022 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8" podUID="7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 21 14:46:19.536119 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:19.536090 2576 generic.go:356] "Generic (PLEG): container finished" podID="7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24" containerID="ddeaf25ce5d17b28216487a5a66e505eec1d980167bea97e734bafe1ee795503" exitCode=0 Jul 21 14:46:19.536486 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:19.536128 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8" event={"ID":"7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24","Type":"ContainerDied","Data":"ddeaf25ce5d17b28216487a5a66e505eec1d980167bea97e734bafe1ee795503"} Jul 21 14:46:19.536486 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:19.536412 2576 scope.go:117] "RemoveContainer" containerID="ddeaf25ce5d17b28216487a5a66e505eec1d980167bea97e734bafe1ee795503" Jul 21 14:46:19.537290 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:19.537262 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:46:19.537362 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:19.537329 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:46:19.537402 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:19.537385 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:46:20.543603 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:20.543566 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8" event={"ID":"7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24","Type":"ContainerStarted","Data":"7dfdd8ac153f2ebebc9da4ca998eac8d696b27e91e8869c66cea996ec2210dec"} Jul 21 14:46:20.726581 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:20.726533 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8" Jul 21 14:46:20.726869 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:20.726847 2576 patch_prober.go:28] interesting pod/e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body= Jul 21 14:46:20.726925 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:20.726896 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8" podUID="7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" Jul 21 14:46:21.727081 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:21.727044 2576 patch_prober.go:28] interesting pod/e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body= Jul 21 14:46:21.727437 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:21.727100 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8" podUID="7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" Jul 21 14:46:22.726976 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:22.726933 2576 patch_prober.go:28] interesting pod/e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body= Jul 21 14:46:22.727133 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:22.727016 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8" podUID="7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" Jul 21 14:46:23.727046 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:23.727018 2576 patch_prober.go:28] interesting pod/e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body= Jul 21 14:46:23.727219 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:23.727066 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8" podUID="7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" Jul 21 14:46:24.727495 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:24.727457 2576 patch_prober.go:28] interesting pod/e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body= Jul 21 14:46:24.727889 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:24.727514 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8" podUID="7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" Jul 21 14:46:25.729920 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:25.729895 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8" Jul 21 14:46:25.730317 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:25.730166 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8" Jul 21 14:46:25.730735 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:25.730715 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8" Jul 21 14:46:42.670495 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:42.670460 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8"] Jul 21 14:46:42.671012 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:42.670698 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8" podUID="7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24" containerName="istio-proxy" containerID="cri-o://7dfdd8ac153f2ebebc9da4ca998eac8d696b27e91e8869c66cea996ec2210dec" gracePeriod=30 Jul 21 14:46:43.689583 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:43.689554 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h"] Jul 21 14:46:43.693258 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:43.693235 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h" Jul 21 14:46:43.696678 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:43.696659 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-98cb868b-gw-openshift-default-dockercfg-v9mwn\"" Jul 21 14:46:43.712710 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:43.712688 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h"] Jul 21 14:46:43.804750 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:43.804713 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84xnp\" (UniqueName: \"kubernetes.io/projected/70775f40-c19b-4203-8497-dc546e063f7b-kube-api-access-84xnp\") pod \"e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h\" (UID: \"70775f40-c19b-4203-8497-dc546e063f7b\") " pod="openshift-ingress/e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h" Jul 21 14:46:43.804956 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:43.804823 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70775f40-c19b-4203-8497-dc546e063f7b-workload-socket\") pod \"e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h\" (UID: \"70775f40-c19b-4203-8497-dc546e063f7b\") " pod="openshift-ingress/e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h" Jul 21 14:46:43.804956 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:43.804920 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70775f40-c19b-4203-8497-dc546e063f7b-workload-certs\") pod \"e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h\" (UID: \"70775f40-c19b-4203-8497-dc546e063f7b\") " pod="openshift-ingress/e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h" Jul 21 14:46:43.805074 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:43.804980 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70775f40-c19b-4203-8497-dc546e063f7b-istio-token\") pod \"e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h\" (UID: \"70775f40-c19b-4203-8497-dc546e063f7b\") " pod="openshift-ingress/e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h" Jul 21 14:46:43.805074 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:43.805031 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70775f40-c19b-4203-8497-dc546e063f7b-credential-socket\") pod \"e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h\" (UID: \"70775f40-c19b-4203-8497-dc546e063f7b\") " pod="openshift-ingress/e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h" Jul 21 14:46:43.805074 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:43.805061 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70775f40-c19b-4203-8497-dc546e063f7b-istiod-ca-cert\") pod \"e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h\" (UID: \"70775f40-c19b-4203-8497-dc546e063f7b\") " pod="openshift-ingress/e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h" Jul 21 14:46:43.805219 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:43.805155 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70775f40-c19b-4203-8497-dc546e063f7b-istio-data\") pod \"e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h\" (UID: \"70775f40-c19b-4203-8497-dc546e063f7b\") " pod="openshift-ingress/e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h" Jul 21 14:46:43.805275 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:43.805255 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70775f40-c19b-4203-8497-dc546e063f7b-istio-envoy\") pod \"e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h\" (UID: \"70775f40-c19b-4203-8497-dc546e063f7b\") " pod="openshift-ingress/e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h" Jul 21 14:46:43.805326 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:43.805284 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70775f40-c19b-4203-8497-dc546e063f7b-istio-podinfo\") pod \"e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h\" (UID: \"70775f40-c19b-4203-8497-dc546e063f7b\") " pod="openshift-ingress/e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h" Jul 21 14:46:43.905793 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:43.905756 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70775f40-c19b-4203-8497-dc546e063f7b-credential-socket\") pod \"e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h\" (UID: \"70775f40-c19b-4203-8497-dc546e063f7b\") " pod="openshift-ingress/e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h" Jul 21 14:46:43.905936 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:43.905807 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70775f40-c19b-4203-8497-dc546e063f7b-istiod-ca-cert\") pod \"e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h\" (UID: \"70775f40-c19b-4203-8497-dc546e063f7b\") " pod="openshift-ingress/e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h" Jul 21 14:46:43.905936 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:43.905829 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70775f40-c19b-4203-8497-dc546e063f7b-istio-data\") pod \"e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h\" (UID: \"70775f40-c19b-4203-8497-dc546e063f7b\") " pod="openshift-ingress/e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h" Jul 21 14:46:43.905936 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:43.905855 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70775f40-c19b-4203-8497-dc546e063f7b-istio-envoy\") pod \"e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h\" (UID: \"70775f40-c19b-4203-8497-dc546e063f7b\") " pod="openshift-ingress/e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h" Jul 21 14:46:43.906063 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:43.905966 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70775f40-c19b-4203-8497-dc546e063f7b-istio-podinfo\") pod \"e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h\" (UID: \"70775f40-c19b-4203-8497-dc546e063f7b\") " pod="openshift-ingress/e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h" Jul 21 14:46:43.906114 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:43.906075 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84xnp\" (UniqueName: \"kubernetes.io/projected/70775f40-c19b-4203-8497-dc546e063f7b-kube-api-access-84xnp\") pod \"e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h\" (UID: \"70775f40-c19b-4203-8497-dc546e063f7b\") " pod="openshift-ingress/e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h" Jul 21 14:46:43.906169 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:43.906132 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70775f40-c19b-4203-8497-dc546e063f7b-workload-socket\") pod \"e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h\" (UID: \"70775f40-c19b-4203-8497-dc546e063f7b\") " pod="openshift-ingress/e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h" Jul 21 14:46:43.906231 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:43.906201 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70775f40-c19b-4203-8497-dc546e063f7b-workload-certs\") pod \"e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h\" (UID: \"70775f40-c19b-4203-8497-dc546e063f7b\") " pod="openshift-ingress/e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h" Jul 21 14:46:43.906231 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:43.906222 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70775f40-c19b-4203-8497-dc546e063f7b-istio-data\") pod \"e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h\" (UID: \"70775f40-c19b-4203-8497-dc546e063f7b\") " pod="openshift-ingress/e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h" Jul 21 14:46:43.906330 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:43.906272 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70775f40-c19b-4203-8497-dc546e063f7b-istio-token\") pod \"e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h\" (UID: \"70775f40-c19b-4203-8497-dc546e063f7b\") " pod="openshift-ingress/e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h" Jul 21 14:46:43.906330 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:43.906284 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70775f40-c19b-4203-8497-dc546e063f7b-credential-socket\") pod \"e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h\" (UID: \"70775f40-c19b-4203-8497-dc546e063f7b\") " pod="openshift-ingress/e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h" Jul 21 14:46:43.906528 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:43.906486 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70775f40-c19b-4203-8497-dc546e063f7b-workload-certs\") pod \"e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h\" (UID: \"70775f40-c19b-4203-8497-dc546e063f7b\") " pod="openshift-ingress/e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h" Jul 21 14:46:43.906652 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:43.906573 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70775f40-c19b-4203-8497-dc546e063f7b-workload-socket\") pod \"e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h\" (UID: \"70775f40-c19b-4203-8497-dc546e063f7b\") " pod="openshift-ingress/e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h" Jul 21 14:46:43.906652 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:43.906575 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70775f40-c19b-4203-8497-dc546e063f7b-istiod-ca-cert\") pod \"e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h\" (UID: \"70775f40-c19b-4203-8497-dc546e063f7b\") " pod="openshift-ingress/e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h" Jul 21 14:46:43.908168 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:43.908147 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70775f40-c19b-4203-8497-dc546e063f7b-istio-envoy\") pod \"e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h\" (UID: \"70775f40-c19b-4203-8497-dc546e063f7b\") " pod="openshift-ingress/e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h" Jul 21 14:46:43.908427 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:43.908409 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70775f40-c19b-4203-8497-dc546e063f7b-istio-podinfo\") pod \"e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h\" (UID: \"70775f40-c19b-4203-8497-dc546e063f7b\") " pod="openshift-ingress/e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h" Jul 21 14:46:43.924499 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:43.924471 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70775f40-c19b-4203-8497-dc546e063f7b-istio-token\") pod \"e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h\" (UID: \"70775f40-c19b-4203-8497-dc546e063f7b\") " pod="openshift-ingress/e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h" Jul 21 14:46:43.924729 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:43.924711 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84xnp\" (UniqueName: \"kubernetes.io/projected/70775f40-c19b-4203-8497-dc546e063f7b-kube-api-access-84xnp\") pod \"e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h\" (UID: \"70775f40-c19b-4203-8497-dc546e063f7b\") " pod="openshift-ingress/e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h" Jul 21 14:46:44.003010 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:44.002988 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h" Jul 21 14:46:44.146285 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:44.146259 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h"] Jul 21 14:46:44.147430 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:46:44.147401 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70775f40_c19b_4203_8497_dc546e063f7b.slice/crio-ac43369d71845710bfb510cf86be173cafc8a7a456f7a898ec1f66637c08ac34 WatchSource:0}: Error finding container ac43369d71845710bfb510cf86be173cafc8a7a456f7a898ec1f66637c08ac34: Status 404 returned error can't find the container with id ac43369d71845710bfb510cf86be173cafc8a7a456f7a898ec1f66637c08ac34 Jul 21 14:46:44.149725 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:44.149690 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:46:44.149791 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:44.149759 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:46:44.149836 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:44.149807 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:46:44.671888 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:44.671851 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h" event={"ID":"70775f40-c19b-4203-8497-dc546e063f7b","Type":"ContainerStarted","Data":"b68547fdc89f12e048fbdb22c19756a6f8c4905a6613495e432886bade627ea2"} Jul 21 14:46:44.672066 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:44.671944 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h" event={"ID":"70775f40-c19b-4203-8497-dc546e063f7b","Type":"ContainerStarted","Data":"ac43369d71845710bfb510cf86be173cafc8a7a456f7a898ec1f66637c08ac34"} Jul 21 14:46:44.701326 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:44.701280 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h" podStartSLOduration=1.701266204 podStartE2EDuration="1.701266204s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:46:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:46:44.698940339 +0000 UTC m=+1731.716843913" watchObservedRunningTime="2026-07-21 14:46:44.701266204 +0000 UTC m=+1731.719169777" Jul 21 14:46:45.003376 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:45.003350 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h" Jul 21 14:46:45.007587 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:45.007564 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h" Jul 21 14:46:45.677223 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:45.677197 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h" Jul 21 14:46:45.678001 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:45.677982 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h" Jul 21 14:46:47.921467 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:47.921444 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8" Jul 21 14:46:48.038583 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:48.038560 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24-istio-envoy\") pod \"7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24\" (UID: \"7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24\") " Jul 21 14:46:48.038735 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:48.038607 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24-workload-certs\") pod \"7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24\" (UID: \"7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24\") " Jul 21 14:46:48.038735 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:48.038628 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24-istio-podinfo\") pod \"7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24\" (UID: \"7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24\") " Jul 21 14:46:48.038735 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:48.038658 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2nkp5\" (UniqueName: \"kubernetes.io/projected/7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24-kube-api-access-2nkp5\") pod \"7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24\" (UID: \"7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24\") " Jul 21 14:46:48.038735 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:48.038676 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24-credential-socket\") pod \"7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24\" (UID: \"7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24\") " Jul 21 14:46:48.038735 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:48.038696 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24-istiod-ca-cert\") pod \"7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24\" (UID: \"7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24\") " Jul 21 14:46:48.038735 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:48.038719 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24-istio-data\") pod \"7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24\" (UID: \"7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24\") " Jul 21 14:46:48.039315 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:48.038766 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24-workload-socket\") pod \"7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24\" (UID: \"7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24\") " Jul 21 14:46:48.039315 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:48.038865 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24-istio-token\") pod \"7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24\" (UID: \"7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24\") " Jul 21 14:46:48.039315 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:48.038904 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24" (UID: "7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:46:48.039315 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:48.039069 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24" (UID: "7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:46:48.039315 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:48.039140 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24" (UID: "7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:46:48.039315 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:48.039194 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24" (UID: "7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 14:46:48.039315 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:48.039234 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24-workload-socket\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:46:48.039315 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:48.039254 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24-workload-certs\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:46:48.039315 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:48.039269 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24-credential-socket\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:46:48.039758 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:48.039586 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24-istio-data" (OuterVolumeSpecName: "istio-data") pod "7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24" (UID: "7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:46:48.041133 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:48.041105 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24" (UID: "7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 21 14:46:48.041258 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:48.041242 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24-istio-token" (OuterVolumeSpecName: "istio-token") pod "7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24" (UID: "7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 14:46:48.041321 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:48.041260 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24" (UID: "7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:46:48.041321 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:48.041279 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24-kube-api-access-2nkp5" (OuterVolumeSpecName: "kube-api-access-2nkp5") pod "7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24" (UID: "7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24"). InnerVolumeSpecName "kube-api-access-2nkp5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 14:46:48.140107 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:48.140084 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24-istio-podinfo\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:46:48.140107 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:48.140104 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2nkp5\" (UniqueName: \"kubernetes.io/projected/7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24-kube-api-access-2nkp5\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:46:48.140234 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:48.140113 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24-istiod-ca-cert\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:46:48.140234 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:48.140123 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24-istio-data\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:46:48.140234 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:48.140130 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24-istio-token\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:46:48.140234 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:48.140138 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24-istio-envoy\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:46:48.695453 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:48.695426 2576 generic.go:356] "Generic (PLEG): container finished" podID="7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24" containerID="7dfdd8ac153f2ebebc9da4ca998eac8d696b27e91e8869c66cea996ec2210dec" exitCode=0 Jul 21 14:46:48.695630 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:48.695476 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8" Jul 21 14:46:48.695630 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:48.695513 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8" event={"ID":"7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24","Type":"ContainerDied","Data":"7dfdd8ac153f2ebebc9da4ca998eac8d696b27e91e8869c66cea996ec2210dec"} Jul 21 14:46:48.695630 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:48.695577 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8" event={"ID":"7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24","Type":"ContainerDied","Data":"9d6f36c9320c923cdc74c938f1cb0e4e353e47ccad2e4117f39eb94726871a36"} Jul 21 14:46:48.695630 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:48.695606 2576 scope.go:117] "RemoveContainer" containerID="7dfdd8ac153f2ebebc9da4ca998eac8d696b27e91e8869c66cea996ec2210dec" Jul 21 14:46:48.705462 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:48.705444 2576 scope.go:117] "RemoveContainer" containerID="ddeaf25ce5d17b28216487a5a66e505eec1d980167bea97e734bafe1ee795503" Jul 21 14:46:48.716332 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:48.714682 2576 scope.go:117] "RemoveContainer" containerID="7dfdd8ac153f2ebebc9da4ca998eac8d696b27e91e8869c66cea996ec2210dec" Jul 21 14:46:48.716332 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:46:48.715700 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7dfdd8ac153f2ebebc9da4ca998eac8d696b27e91e8869c66cea996ec2210dec\": container with ID starting with 7dfdd8ac153f2ebebc9da4ca998eac8d696b27e91e8869c66cea996ec2210dec not found: ID does not exist" containerID="7dfdd8ac153f2ebebc9da4ca998eac8d696b27e91e8869c66cea996ec2210dec" Jul 21 14:46:48.716332 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:48.715729 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7dfdd8ac153f2ebebc9da4ca998eac8d696b27e91e8869c66cea996ec2210dec"} err="failed to get container status \"7dfdd8ac153f2ebebc9da4ca998eac8d696b27e91e8869c66cea996ec2210dec\": rpc error: code = NotFound desc = could not find container \"7dfdd8ac153f2ebebc9da4ca998eac8d696b27e91e8869c66cea996ec2210dec\": container with ID starting with 7dfdd8ac153f2ebebc9da4ca998eac8d696b27e91e8869c66cea996ec2210dec not found: ID does not exist" Jul 21 14:46:48.716332 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:48.715749 2576 scope.go:117] "RemoveContainer" containerID="ddeaf25ce5d17b28216487a5a66e505eec1d980167bea97e734bafe1ee795503" Jul 21 14:46:48.716332 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:46:48.716119 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ddeaf25ce5d17b28216487a5a66e505eec1d980167bea97e734bafe1ee795503\": container with ID starting with ddeaf25ce5d17b28216487a5a66e505eec1d980167bea97e734bafe1ee795503 not found: ID does not exist" containerID="ddeaf25ce5d17b28216487a5a66e505eec1d980167bea97e734bafe1ee795503" Jul 21 14:46:48.716332 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:48.716146 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddeaf25ce5d17b28216487a5a66e505eec1d980167bea97e734bafe1ee795503"} err="failed to get container status \"ddeaf25ce5d17b28216487a5a66e505eec1d980167bea97e734bafe1ee795503\": rpc error: code = NotFound desc = could not find container \"ddeaf25ce5d17b28216487a5a66e505eec1d980167bea97e734bafe1ee795503\": container with ID starting with ddeaf25ce5d17b28216487a5a66e505eec1d980167bea97e734bafe1ee795503 not found: ID does not exist" Jul 21 14:46:48.723266 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:48.723244 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8"] Jul 21 14:46:48.730376 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:48.730356 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-78a7b505-openshift-default-696d47c969-tn5t8"] Jul 21 14:46:49.525948 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:46:49.525918 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24" path="/var/lib/kubelet/pods/7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24/volumes" Jul 21 14:47:00.678750 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:00.678717 2576 patch_prober.go:28] interesting pod/e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body= Jul 21 14:47:00.679174 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:00.678795 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h" podUID="70775f40-c19b-4203-8497-dc546e063f7b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" Jul 21 14:47:00.768537 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:00.768510 2576 generic.go:356] "Generic (PLEG): container finished" podID="70775f40-c19b-4203-8497-dc546e063f7b" containerID="b68547fdc89f12e048fbdb22c19756a6f8c4905a6613495e432886bade627ea2" exitCode=0 Jul 21 14:47:00.768750 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:00.768590 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h" event={"ID":"70775f40-c19b-4203-8497-dc546e063f7b","Type":"ContainerDied","Data":"b68547fdc89f12e048fbdb22c19756a6f8c4905a6613495e432886bade627ea2"} Jul 21 14:47:00.769006 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:00.768991 2576 scope.go:117] "RemoveContainer" containerID="b68547fdc89f12e048fbdb22c19756a6f8c4905a6613495e432886bade627ea2" Jul 21 14:47:00.769977 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:00.769948 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:47:00.770048 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:00.770017 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:47:00.770092 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:00.770049 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:47:01.775009 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:01.774975 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h" event={"ID":"70775f40-c19b-4203-8497-dc546e063f7b","Type":"ContainerStarted","Data":"8cfb77997bed497fe7167d532350130285fea6cc478a66e09d2f79aa9c46824a"} Jul 21 14:47:02.003603 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:02.003561 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h" Jul 21 14:47:02.004009 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:02.003976 2576 patch_prober.go:28] interesting pod/e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body= Jul 21 14:47:02.004125 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:02.004046 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h" podUID="70775f40-c19b-4203-8497-dc546e063f7b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" Jul 21 14:47:03.004281 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:03.003842 2576 patch_prober.go:28] interesting pod/e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body= Jul 21 14:47:03.004281 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:03.003898 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h" podUID="70775f40-c19b-4203-8497-dc546e063f7b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" Jul 21 14:47:04.004362 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:04.004325 2576 patch_prober.go:28] interesting pod/e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body= Jul 21 14:47:04.004880 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:04.004392 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h" podUID="70775f40-c19b-4203-8497-dc546e063f7b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" Jul 21 14:47:05.003360 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:05.003325 2576 patch_prober.go:28] interesting pod/e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body= Jul 21 14:47:05.003687 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:05.003656 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h" podUID="70775f40-c19b-4203-8497-dc546e063f7b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" Jul 21 14:47:06.007254 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:06.007225 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h" Jul 21 14:47:06.007655 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:06.007481 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h" Jul 21 14:47:06.008077 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:06.008061 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h" Jul 21 14:47:26.545095 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:26.545064 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h"] Jul 21 14:47:26.545623 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:26.545309 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h" podUID="70775f40-c19b-4203-8497-dc546e063f7b" containerName="istio-proxy" containerID="cri-o://8cfb77997bed497fe7167d532350130285fea6cc478a66e09d2f79aa9c46824a" gracePeriod=30 Jul 21 14:47:27.381115 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:27.381076 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm"] Jul 21 14:47:27.381530 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:27.381512 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24" containerName="istio-proxy" Jul 21 14:47:27.381624 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:27.381533 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24" containerName="istio-proxy" Jul 21 14:47:27.381624 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:27.381558 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24" containerName="istio-proxy" Jul 21 14:47:27.381624 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:27.381567 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24" containerName="istio-proxy" Jul 21 14:47:27.381811 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:27.381691 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24" containerName="istio-proxy" Jul 21 14:47:27.384794 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:27.384761 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm" Jul 21 14:47:27.388482 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:27.388459 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-0a74b282-openshift-default-dockercfg-qtj5n\"" Jul 21 14:47:27.410483 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:27.410460 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm"] Jul 21 14:47:27.468499 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:27.468466 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7122299e-8d7b-411a-b68e-ea1e21082c23-workload-socket\") pod \"e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm\" (UID: \"7122299e-8d7b-411a-b68e-ea1e21082c23\") " pod="openshift-ingress/e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm" Jul 21 14:47:27.468683 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:27.468531 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7122299e-8d7b-411a-b68e-ea1e21082c23-istio-token\") pod \"e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm\" (UID: \"7122299e-8d7b-411a-b68e-ea1e21082c23\") " pod="openshift-ingress/e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm" Jul 21 14:47:27.468683 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:27.468592 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7122299e-8d7b-411a-b68e-ea1e21082c23-workload-certs\") pod \"e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm\" (UID: \"7122299e-8d7b-411a-b68e-ea1e21082c23\") " pod="openshift-ingress/e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm" Jul 21 14:47:27.468683 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:27.468633 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7122299e-8d7b-411a-b68e-ea1e21082c23-istio-podinfo\") pod \"e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm\" (UID: \"7122299e-8d7b-411a-b68e-ea1e21082c23\") " pod="openshift-ingress/e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm" Jul 21 14:47:27.468683 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:27.468662 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7122299e-8d7b-411a-b68e-ea1e21082c23-istiod-ca-cert\") pod \"e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm\" (UID: \"7122299e-8d7b-411a-b68e-ea1e21082c23\") " pod="openshift-ingress/e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm" Jul 21 14:47:27.468956 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:27.468697 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7122299e-8d7b-411a-b68e-ea1e21082c23-istio-envoy\") pod \"e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm\" (UID: \"7122299e-8d7b-411a-b68e-ea1e21082c23\") " pod="openshift-ingress/e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm" Jul 21 14:47:27.468956 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:27.468740 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7122299e-8d7b-411a-b68e-ea1e21082c23-istio-data\") pod \"e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm\" (UID: \"7122299e-8d7b-411a-b68e-ea1e21082c23\") " pod="openshift-ingress/e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm" Jul 21 14:47:27.468956 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:27.468794 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8xvw\" (UniqueName: \"kubernetes.io/projected/7122299e-8d7b-411a-b68e-ea1e21082c23-kube-api-access-j8xvw\") pod \"e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm\" (UID: \"7122299e-8d7b-411a-b68e-ea1e21082c23\") " pod="openshift-ingress/e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm" Jul 21 14:47:27.468956 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:27.468834 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7122299e-8d7b-411a-b68e-ea1e21082c23-credential-socket\") pod \"e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm\" (UID: \"7122299e-8d7b-411a-b68e-ea1e21082c23\") " pod="openshift-ingress/e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm" Jul 21 14:47:27.569515 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:27.569487 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7122299e-8d7b-411a-b68e-ea1e21082c23-workload-certs\") pod \"e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm\" (UID: \"7122299e-8d7b-411a-b68e-ea1e21082c23\") " pod="openshift-ingress/e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm" Jul 21 14:47:27.569977 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:27.569523 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7122299e-8d7b-411a-b68e-ea1e21082c23-istio-podinfo\") pod \"e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm\" (UID: \"7122299e-8d7b-411a-b68e-ea1e21082c23\") " pod="openshift-ingress/e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm" Jul 21 14:47:27.569977 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:27.569543 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7122299e-8d7b-411a-b68e-ea1e21082c23-istiod-ca-cert\") pod \"e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm\" (UID: \"7122299e-8d7b-411a-b68e-ea1e21082c23\") " pod="openshift-ingress/e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm" Jul 21 14:47:27.569977 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:27.569679 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7122299e-8d7b-411a-b68e-ea1e21082c23-istio-envoy\") pod \"e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm\" (UID: \"7122299e-8d7b-411a-b68e-ea1e21082c23\") " pod="openshift-ingress/e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm" Jul 21 14:47:27.569977 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:27.569744 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7122299e-8d7b-411a-b68e-ea1e21082c23-istio-data\") pod \"e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm\" (UID: \"7122299e-8d7b-411a-b68e-ea1e21082c23\") " pod="openshift-ingress/e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm" Jul 21 14:47:27.569977 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:27.569775 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8xvw\" (UniqueName: \"kubernetes.io/projected/7122299e-8d7b-411a-b68e-ea1e21082c23-kube-api-access-j8xvw\") pod \"e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm\" (UID: \"7122299e-8d7b-411a-b68e-ea1e21082c23\") " pod="openshift-ingress/e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm" Jul 21 14:47:27.569977 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:27.569853 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7122299e-8d7b-411a-b68e-ea1e21082c23-credential-socket\") pod \"e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm\" (UID: \"7122299e-8d7b-411a-b68e-ea1e21082c23\") " pod="openshift-ingress/e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm" Jul 21 14:47:27.569977 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:27.569940 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7122299e-8d7b-411a-b68e-ea1e21082c23-workload-certs\") pod \"e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm\" (UID: \"7122299e-8d7b-411a-b68e-ea1e21082c23\") " pod="openshift-ingress/e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm" Jul 21 14:47:27.570388 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:27.570061 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7122299e-8d7b-411a-b68e-ea1e21082c23-workload-socket\") pod \"e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm\" (UID: \"7122299e-8d7b-411a-b68e-ea1e21082c23\") " pod="openshift-ingress/e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm" Jul 21 14:47:27.570388 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:27.570114 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7122299e-8d7b-411a-b68e-ea1e21082c23-istio-data\") pod \"e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm\" (UID: \"7122299e-8d7b-411a-b68e-ea1e21082c23\") " pod="openshift-ingress/e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm" Jul 21 14:47:27.570388 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:27.570129 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7122299e-8d7b-411a-b68e-ea1e21082c23-istio-token\") pod \"e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm\" (UID: \"7122299e-8d7b-411a-b68e-ea1e21082c23\") " pod="openshift-ingress/e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm" Jul 21 14:47:27.570388 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:27.570208 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7122299e-8d7b-411a-b68e-ea1e21082c23-credential-socket\") pod \"e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm\" (UID: \"7122299e-8d7b-411a-b68e-ea1e21082c23\") " pod="openshift-ingress/e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm" Jul 21 14:47:27.570388 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:27.570343 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7122299e-8d7b-411a-b68e-ea1e21082c23-istiod-ca-cert\") pod \"e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm\" (UID: \"7122299e-8d7b-411a-b68e-ea1e21082c23\") " pod="openshift-ingress/e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm" Jul 21 14:47:27.570553 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:27.570453 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7122299e-8d7b-411a-b68e-ea1e21082c23-workload-socket\") pod \"e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm\" (UID: \"7122299e-8d7b-411a-b68e-ea1e21082c23\") " pod="openshift-ingress/e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm" Jul 21 14:47:27.572006 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:27.571984 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7122299e-8d7b-411a-b68e-ea1e21082c23-istio-envoy\") pod \"e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm\" (UID: \"7122299e-8d7b-411a-b68e-ea1e21082c23\") " pod="openshift-ingress/e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm" Jul 21 14:47:27.572147 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:27.572128 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7122299e-8d7b-411a-b68e-ea1e21082c23-istio-podinfo\") pod \"e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm\" (UID: \"7122299e-8d7b-411a-b68e-ea1e21082c23\") " pod="openshift-ingress/e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm" Jul 21 14:47:27.593376 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:27.593346 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7122299e-8d7b-411a-b68e-ea1e21082c23-istio-token\") pod \"e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm\" (UID: \"7122299e-8d7b-411a-b68e-ea1e21082c23\") " pod="openshift-ingress/e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm" Jul 21 14:47:27.599752 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:27.599729 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8xvw\" (UniqueName: \"kubernetes.io/projected/7122299e-8d7b-411a-b68e-ea1e21082c23-kube-api-access-j8xvw\") pod \"e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm\" (UID: \"7122299e-8d7b-411a-b68e-ea1e21082c23\") " pod="openshift-ingress/e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm" Jul 21 14:47:27.695160 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:27.695102 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm" Jul 21 14:47:27.851138 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:27.851113 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm"] Jul 21 14:47:27.852661 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:47:27.852638 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7122299e_8d7b_411a_b68e_ea1e21082c23.slice/crio-cdd9844e63d78900259771eca119a9091fc25b0be711485d7d6cec53dca2318a WatchSource:0}: Error finding container cdd9844e63d78900259771eca119a9091fc25b0be711485d7d6cec53dca2318a: Status 404 returned error can't find the container with id cdd9844e63d78900259771eca119a9091fc25b0be711485d7d6cec53dca2318a Jul 21 14:47:27.854735 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:27.854702 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:47:27.854856 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:27.854795 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:47:27.854921 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:27.854852 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:47:27.914508 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:27.914478 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm" event={"ID":"7122299e-8d7b-411a-b68e-ea1e21082c23","Type":"ContainerStarted","Data":"e9993a758dad0f18086a2d72fb43b66e163041b06205df947a7dd99f455fa998"} Jul 21 14:47:27.914595 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:27.914529 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm" event={"ID":"7122299e-8d7b-411a-b68e-ea1e21082c23","Type":"ContainerStarted","Data":"cdd9844e63d78900259771eca119a9091fc25b0be711485d7d6cec53dca2318a"} Jul 21 14:47:27.949725 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:27.949633 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm" podStartSLOduration=0.949615836 podStartE2EDuration="949.615836ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:47:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:47:27.948132843 +0000 UTC m=+1774.966036424" watchObservedRunningTime="2026-07-21 14:47:27.949615836 +0000 UTC m=+1774.967519413" Jul 21 14:47:28.695836 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:28.695799 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm" Jul 21 14:47:28.700361 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:28.700337 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm" Jul 21 14:47:28.919972 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:28.919951 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm" Jul 21 14:47:28.920756 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:28.920739 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm" Jul 21 14:47:31.796069 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:31.796050 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h" Jul 21 14:47:31.909283 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:31.909221 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70775f40-c19b-4203-8497-dc546e063f7b-istio-podinfo\") pod \"70775f40-c19b-4203-8497-dc546e063f7b\" (UID: \"70775f40-c19b-4203-8497-dc546e063f7b\") " Jul 21 14:47:31.909283 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:31.909275 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70775f40-c19b-4203-8497-dc546e063f7b-istio-token\") pod \"70775f40-c19b-4203-8497-dc546e063f7b\" (UID: \"70775f40-c19b-4203-8497-dc546e063f7b\") " Jul 21 14:47:31.909427 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:31.909317 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70775f40-c19b-4203-8497-dc546e063f7b-istio-data\") pod \"70775f40-c19b-4203-8497-dc546e063f7b\" (UID: \"70775f40-c19b-4203-8497-dc546e063f7b\") " Jul 21 14:47:31.909427 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:31.909359 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70775f40-c19b-4203-8497-dc546e063f7b-workload-certs\") pod \"70775f40-c19b-4203-8497-dc546e063f7b\" (UID: \"70775f40-c19b-4203-8497-dc546e063f7b\") " Jul 21 14:47:31.909575 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:31.909546 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70775f40-c19b-4203-8497-dc546e063f7b-istiod-ca-cert\") pod \"70775f40-c19b-4203-8497-dc546e063f7b\" (UID: \"70775f40-c19b-4203-8497-dc546e063f7b\") " Jul 21 14:47:31.909722 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:31.909601 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70775f40-c19b-4203-8497-dc546e063f7b-istio-envoy\") pod \"70775f40-c19b-4203-8497-dc546e063f7b\" (UID: \"70775f40-c19b-4203-8497-dc546e063f7b\") " Jul 21 14:47:31.909722 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:31.909643 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-84xnp\" (UniqueName: \"kubernetes.io/projected/70775f40-c19b-4203-8497-dc546e063f7b-kube-api-access-84xnp\") pod \"70775f40-c19b-4203-8497-dc546e063f7b\" (UID: \"70775f40-c19b-4203-8497-dc546e063f7b\") " Jul 21 14:47:31.909722 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:31.909689 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70775f40-c19b-4203-8497-dc546e063f7b-workload-socket\") pod \"70775f40-c19b-4203-8497-dc546e063f7b\" (UID: \"70775f40-c19b-4203-8497-dc546e063f7b\") " Jul 21 14:47:31.909934 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:31.909738 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70775f40-c19b-4203-8497-dc546e063f7b-credential-socket\") pod \"70775f40-c19b-4203-8497-dc546e063f7b\" (UID: \"70775f40-c19b-4203-8497-dc546e063f7b\") " Jul 21 14:47:31.909934 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:31.909684 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70775f40-c19b-4203-8497-dc546e063f7b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "70775f40-c19b-4203-8497-dc546e063f7b" (UID: "70775f40-c19b-4203-8497-dc546e063f7b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:47:31.909934 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:31.909901 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70775f40-c19b-4203-8497-dc546e063f7b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "70775f40-c19b-4203-8497-dc546e063f7b" (UID: "70775f40-c19b-4203-8497-dc546e063f7b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 14:47:31.910098 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:31.910068 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70775f40-c19b-4203-8497-dc546e063f7b-workload-certs\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:47:31.910098 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:31.910084 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70775f40-c19b-4203-8497-dc546e063f7b-istiod-ca-cert\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:47:31.910200 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:31.910140 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70775f40-c19b-4203-8497-dc546e063f7b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "70775f40-c19b-4203-8497-dc546e063f7b" (UID: "70775f40-c19b-4203-8497-dc546e063f7b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:47:31.910200 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:31.910183 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70775f40-c19b-4203-8497-dc546e063f7b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "70775f40-c19b-4203-8497-dc546e063f7b" (UID: "70775f40-c19b-4203-8497-dc546e063f7b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:47:31.910370 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:31.910288 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70775f40-c19b-4203-8497-dc546e063f7b-istio-data" (OuterVolumeSpecName: "istio-data") pod "70775f40-c19b-4203-8497-dc546e063f7b" (UID: "70775f40-c19b-4203-8497-dc546e063f7b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:47:31.911560 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:31.911535 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70775f40-c19b-4203-8497-dc546e063f7b-istio-token" (OuterVolumeSpecName: "istio-token") pod "70775f40-c19b-4203-8497-dc546e063f7b" (UID: "70775f40-c19b-4203-8497-dc546e063f7b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 14:47:31.911839 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:31.911815 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70775f40-c19b-4203-8497-dc546e063f7b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "70775f40-c19b-4203-8497-dc546e063f7b" (UID: "70775f40-c19b-4203-8497-dc546e063f7b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:47:31.911914 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:31.911883 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/70775f40-c19b-4203-8497-dc546e063f7b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "70775f40-c19b-4203-8497-dc546e063f7b" (UID: "70775f40-c19b-4203-8497-dc546e063f7b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 21 14:47:31.911961 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:31.911939 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70775f40-c19b-4203-8497-dc546e063f7b-kube-api-access-84xnp" (OuterVolumeSpecName: "kube-api-access-84xnp") pod "70775f40-c19b-4203-8497-dc546e063f7b" (UID: "70775f40-c19b-4203-8497-dc546e063f7b"). InnerVolumeSpecName "kube-api-access-84xnp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 14:47:31.937083 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:31.937053 2576 generic.go:356] "Generic (PLEG): container finished" podID="70775f40-c19b-4203-8497-dc546e063f7b" containerID="8cfb77997bed497fe7167d532350130285fea6cc478a66e09d2f79aa9c46824a" exitCode=0 Jul 21 14:47:31.937155 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:31.937103 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h" event={"ID":"70775f40-c19b-4203-8497-dc546e063f7b","Type":"ContainerDied","Data":"8cfb77997bed497fe7167d532350130285fea6cc478a66e09d2f79aa9c46824a"} Jul 21 14:47:31.937206 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:31.937152 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h" event={"ID":"70775f40-c19b-4203-8497-dc546e063f7b","Type":"ContainerDied","Data":"ac43369d71845710bfb510cf86be173cafc8a7a456f7a898ec1f66637c08ac34"} Jul 21 14:47:31.937206 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:31.937175 2576 scope.go:117] "RemoveContainer" containerID="8cfb77997bed497fe7167d532350130285fea6cc478a66e09d2f79aa9c46824a" Jul 21 14:47:31.937206 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:31.937109 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h" Jul 21 14:47:31.946093 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:31.946077 2576 scope.go:117] "RemoveContainer" containerID="b68547fdc89f12e048fbdb22c19756a6f8c4905a6613495e432886bade627ea2" Jul 21 14:47:31.953857 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:31.953843 2576 scope.go:117] "RemoveContainer" containerID="8cfb77997bed497fe7167d532350130285fea6cc478a66e09d2f79aa9c46824a" Jul 21 14:47:31.954065 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:47:31.954046 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8cfb77997bed497fe7167d532350130285fea6cc478a66e09d2f79aa9c46824a\": container with ID starting with 8cfb77997bed497fe7167d532350130285fea6cc478a66e09d2f79aa9c46824a not found: ID does not exist" containerID="8cfb77997bed497fe7167d532350130285fea6cc478a66e09d2f79aa9c46824a" Jul 21 14:47:31.954123 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:31.954073 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8cfb77997bed497fe7167d532350130285fea6cc478a66e09d2f79aa9c46824a"} err="failed to get container status \"8cfb77997bed497fe7167d532350130285fea6cc478a66e09d2f79aa9c46824a\": rpc error: code = NotFound desc = could not find container \"8cfb77997bed497fe7167d532350130285fea6cc478a66e09d2f79aa9c46824a\": container with ID starting with 8cfb77997bed497fe7167d532350130285fea6cc478a66e09d2f79aa9c46824a not found: ID does not exist" Jul 21 14:47:31.954123 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:31.954089 2576 scope.go:117] "RemoveContainer" containerID="b68547fdc89f12e048fbdb22c19756a6f8c4905a6613495e432886bade627ea2" Jul 21 14:47:31.954291 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:47:31.954272 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b68547fdc89f12e048fbdb22c19756a6f8c4905a6613495e432886bade627ea2\": container with ID starting with b68547fdc89f12e048fbdb22c19756a6f8c4905a6613495e432886bade627ea2 not found: ID does not exist" containerID="b68547fdc89f12e048fbdb22c19756a6f8c4905a6613495e432886bade627ea2" Jul 21 14:47:31.954349 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:31.954299 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b68547fdc89f12e048fbdb22c19756a6f8c4905a6613495e432886bade627ea2"} err="failed to get container status \"b68547fdc89f12e048fbdb22c19756a6f8c4905a6613495e432886bade627ea2\": rpc error: code = NotFound desc = could not find container \"b68547fdc89f12e048fbdb22c19756a6f8c4905a6613495e432886bade627ea2\": container with ID starting with b68547fdc89f12e048fbdb22c19756a6f8c4905a6613495e432886bade627ea2 not found: ID does not exist" Jul 21 14:47:31.963618 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:31.963599 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h"] Jul 21 14:47:31.968304 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:31.968286 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-98cb868b-gw-openshift-default-7c7465976c-26m9h"] Jul 21 14:47:32.010722 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:32.010705 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70775f40-c19b-4203-8497-dc546e063f7b-istio-token\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:47:32.010722 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:32.010724 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70775f40-c19b-4203-8497-dc546e063f7b-istio-data\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:47:32.010854 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:32.010734 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70775f40-c19b-4203-8497-dc546e063f7b-istio-envoy\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:47:32.010854 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:32.010743 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-84xnp\" (UniqueName: \"kubernetes.io/projected/70775f40-c19b-4203-8497-dc546e063f7b-kube-api-access-84xnp\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:47:32.010854 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:32.010751 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70775f40-c19b-4203-8497-dc546e063f7b-workload-socket\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:47:32.010854 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:32.010759 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70775f40-c19b-4203-8497-dc546e063f7b-credential-socket\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:47:32.010854 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:32.010768 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70775f40-c19b-4203-8497-dc546e063f7b-istio-podinfo\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:47:33.531739 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:33.531703 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70775f40-c19b-4203-8497-dc546e063f7b" path="/var/lib/kubelet/pods/70775f40-c19b-4203-8497-dc546e063f7b/volumes" Jul 21 14:47:44.419955 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:44.418987 2576 patch_prober.go:28] interesting pod/e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": read tcp 10.133.0.2:46004->10.133.0.44:15021: read: connection reset by peer" start-of-body= Jul 21 14:47:44.419955 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:44.419055 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm" podUID="7122299e-8d7b-411a-b68e-ea1e21082c23" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": read tcp 10.133.0.2:46004->10.133.0.44:15021: read: connection reset by peer" Jul 21 14:47:45.008371 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:45.008338 2576 generic.go:356] "Generic (PLEG): container finished" podID="7122299e-8d7b-411a-b68e-ea1e21082c23" containerID="e9993a758dad0f18086a2d72fb43b66e163041b06205df947a7dd99f455fa998" exitCode=0 Jul 21 14:47:45.008565 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:45.008421 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm" event={"ID":"7122299e-8d7b-411a-b68e-ea1e21082c23","Type":"ContainerDied","Data":"e9993a758dad0f18086a2d72fb43b66e163041b06205df947a7dd99f455fa998"} Jul 21 14:47:45.008886 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:45.008868 2576 scope.go:117] "RemoveContainer" containerID="e9993a758dad0f18086a2d72fb43b66e163041b06205df947a7dd99f455fa998" Jul 21 14:47:45.009931 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:45.009900 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:47:45.010026 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:45.009969 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:47:45.010026 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:45.010015 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:47:46.018746 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:46.018700 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm" event={"ID":"7122299e-8d7b-411a-b68e-ea1e21082c23","Type":"ContainerStarted","Data":"32b7c172e06b2cb463ac92f9888808bb13e32ea363514e9d75780264e471b70d"} Jul 21 14:47:46.695479 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:46.695440 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm" Jul 21 14:47:46.695689 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:46.695597 2576 patch_prober.go:28] interesting pod/e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body= Jul 21 14:47:46.695689 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:46.695646 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm" podUID="7122299e-8d7b-411a-b68e-ea1e21082c23" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" Jul 21 14:47:47.696130 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:47.696086 2576 patch_prober.go:28] interesting pod/e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body= Jul 21 14:47:47.696621 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:47.696156 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm" podUID="7122299e-8d7b-411a-b68e-ea1e21082c23" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" Jul 21 14:47:48.696364 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:48.696325 2576 patch_prober.go:28] interesting pod/e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body= Jul 21 14:47:48.696953 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:48.696923 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm" podUID="7122299e-8d7b-411a-b68e-ea1e21082c23" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" Jul 21 14:47:49.695813 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:49.695743 2576 patch_prober.go:28] interesting pod/e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body= Jul 21 14:47:49.696019 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:49.695835 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm" podUID="7122299e-8d7b-411a-b68e-ea1e21082c23" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" Jul 21 14:47:50.699353 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:50.699318 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm" Jul 21 14:47:50.699741 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:50.699659 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm" Jul 21 14:47:50.700212 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:47:50.700196 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm" Jul 21 14:48:11.433528 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:11.433497 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm"] Jul 21 14:48:11.433984 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:11.433718 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm" podUID="7122299e-8d7b-411a-b68e-ea1e21082c23" containerName="istio-proxy" containerID="cri-o://32b7c172e06b2cb463ac92f9888808bb13e32ea363514e9d75780264e471b70d" gracePeriod=30 Jul 21 14:48:12.174440 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:12.174405 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b"] Jul 21 14:48:12.174839 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:12.174825 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70775f40-c19b-4203-8497-dc546e063f7b" containerName="istio-proxy" Jul 21 14:48:12.174839 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:12.174840 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="70775f40-c19b-4203-8497-dc546e063f7b" containerName="istio-proxy" Jul 21 14:48:12.174929 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:12.174860 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70775f40-c19b-4203-8497-dc546e063f7b" containerName="istio-proxy" Jul 21 14:48:12.174929 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:12.174869 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="70775f40-c19b-4203-8497-dc546e063f7b" containerName="istio-proxy" Jul 21 14:48:12.174929 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:12.174927 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f9c2bb7-fd65-44f0-85bc-34a4ebcbaa24" containerName="istio-proxy" Jul 21 14:48:12.175020 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:12.174937 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="70775f40-c19b-4203-8497-dc546e063f7b" containerName="istio-proxy" Jul 21 14:48:12.175020 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:12.174949 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="70775f40-c19b-4203-8497-dc546e063f7b" containerName="istio-proxy" Jul 21 14:48:12.179106 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:12.179091 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b" Jul 21 14:48:12.181974 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:12.181956 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-e24b8b08-openshift-default-dockercfg-pz5h4\"" Jul 21 14:48:12.194310 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:12.194287 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b"] Jul 21 14:48:12.254169 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:12.254138 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9df5f159-58ca-4bc1-852e-05ff3dd191f5-istio-envoy\") pod \"e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b\" (UID: \"9df5f159-58ca-4bc1-852e-05ff3dd191f5\") " pod="openshift-ingress/e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b" Jul 21 14:48:12.254318 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:12.254186 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9df5f159-58ca-4bc1-852e-05ff3dd191f5-istio-podinfo\") pod \"e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b\" (UID: \"9df5f159-58ca-4bc1-852e-05ff3dd191f5\") " pod="openshift-ingress/e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b" Jul 21 14:48:12.254318 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:12.254214 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9df5f159-58ca-4bc1-852e-05ff3dd191f5-istiod-ca-cert\") pod \"e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b\" (UID: \"9df5f159-58ca-4bc1-852e-05ff3dd191f5\") " pod="openshift-ingress/e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b" Jul 21 14:48:12.254318 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:12.254274 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9df5f159-58ca-4bc1-852e-05ff3dd191f5-workload-socket\") pod \"e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b\" (UID: \"9df5f159-58ca-4bc1-852e-05ff3dd191f5\") " pod="openshift-ingress/e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b" Jul 21 14:48:12.254318 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:12.254298 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9df5f159-58ca-4bc1-852e-05ff3dd191f5-istio-data\") pod \"e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b\" (UID: \"9df5f159-58ca-4bc1-852e-05ff3dd191f5\") " pod="openshift-ingress/e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b" Jul 21 14:48:12.254551 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:12.254365 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9df5f159-58ca-4bc1-852e-05ff3dd191f5-credential-socket\") pod \"e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b\" (UID: \"9df5f159-58ca-4bc1-852e-05ff3dd191f5\") " pod="openshift-ingress/e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b" Jul 21 14:48:12.254551 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:12.254415 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9df5f159-58ca-4bc1-852e-05ff3dd191f5-workload-certs\") pod \"e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b\" (UID: \"9df5f159-58ca-4bc1-852e-05ff3dd191f5\") " pod="openshift-ingress/e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b" Jul 21 14:48:12.254551 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:12.254491 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44znh\" (UniqueName: \"kubernetes.io/projected/9df5f159-58ca-4bc1-852e-05ff3dd191f5-kube-api-access-44znh\") pod \"e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b\" (UID: \"9df5f159-58ca-4bc1-852e-05ff3dd191f5\") " pod="openshift-ingress/e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b" Jul 21 14:48:12.254551 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:12.254517 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9df5f159-58ca-4bc1-852e-05ff3dd191f5-istio-token\") pod \"e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b\" (UID: \"9df5f159-58ca-4bc1-852e-05ff3dd191f5\") " pod="openshift-ingress/e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b" Jul 21 14:48:12.355414 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:12.355377 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9df5f159-58ca-4bc1-852e-05ff3dd191f5-istiod-ca-cert\") pod \"e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b\" (UID: \"9df5f159-58ca-4bc1-852e-05ff3dd191f5\") " pod="openshift-ingress/e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b" Jul 21 14:48:12.355414 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:12.355417 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9df5f159-58ca-4bc1-852e-05ff3dd191f5-workload-socket\") pod \"e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b\" (UID: \"9df5f159-58ca-4bc1-852e-05ff3dd191f5\") " pod="openshift-ingress/e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b" Jul 21 14:48:12.355625 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:12.355433 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9df5f159-58ca-4bc1-852e-05ff3dd191f5-istio-data\") pod \"e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b\" (UID: \"9df5f159-58ca-4bc1-852e-05ff3dd191f5\") " pod="openshift-ingress/e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b" Jul 21 14:48:12.355625 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:12.355470 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9df5f159-58ca-4bc1-852e-05ff3dd191f5-credential-socket\") pod \"e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b\" (UID: \"9df5f159-58ca-4bc1-852e-05ff3dd191f5\") " pod="openshift-ingress/e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b" Jul 21 14:48:12.355625 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:12.355500 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9df5f159-58ca-4bc1-852e-05ff3dd191f5-workload-certs\") pod \"e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b\" (UID: \"9df5f159-58ca-4bc1-852e-05ff3dd191f5\") " pod="openshift-ingress/e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b" Jul 21 14:48:12.355625 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:12.355549 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44znh\" (UniqueName: \"kubernetes.io/projected/9df5f159-58ca-4bc1-852e-05ff3dd191f5-kube-api-access-44znh\") pod \"e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b\" (UID: \"9df5f159-58ca-4bc1-852e-05ff3dd191f5\") " pod="openshift-ingress/e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b" Jul 21 14:48:12.355625 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:12.355577 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9df5f159-58ca-4bc1-852e-05ff3dd191f5-istio-token\") pod \"e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b\" (UID: \"9df5f159-58ca-4bc1-852e-05ff3dd191f5\") " pod="openshift-ingress/e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b" Jul 21 14:48:12.355863 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:12.355643 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9df5f159-58ca-4bc1-852e-05ff3dd191f5-istio-envoy\") pod \"e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b\" (UID: \"9df5f159-58ca-4bc1-852e-05ff3dd191f5\") " pod="openshift-ingress/e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b" Jul 21 14:48:12.355863 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:12.355696 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9df5f159-58ca-4bc1-852e-05ff3dd191f5-istio-podinfo\") pod \"e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b\" (UID: \"9df5f159-58ca-4bc1-852e-05ff3dd191f5\") " pod="openshift-ingress/e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b" Jul 21 14:48:12.355962 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:12.355919 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9df5f159-58ca-4bc1-852e-05ff3dd191f5-workload-socket\") pod \"e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b\" (UID: \"9df5f159-58ca-4bc1-852e-05ff3dd191f5\") " pod="openshift-ingress/e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b" Jul 21 14:48:12.356054 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:12.356028 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9df5f159-58ca-4bc1-852e-05ff3dd191f5-credential-socket\") pod \"e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b\" (UID: \"9df5f159-58ca-4bc1-852e-05ff3dd191f5\") " pod="openshift-ingress/e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b" Jul 21 14:48:12.356193 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:12.356173 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9df5f159-58ca-4bc1-852e-05ff3dd191f5-istio-data\") pod \"e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b\" (UID: \"9df5f159-58ca-4bc1-852e-05ff3dd191f5\") " pod="openshift-ingress/e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b" Jul 21 14:48:12.356260 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:12.356217 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9df5f159-58ca-4bc1-852e-05ff3dd191f5-istiod-ca-cert\") pod \"e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b\" (UID: \"9df5f159-58ca-4bc1-852e-05ff3dd191f5\") " pod="openshift-ingress/e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b" Jul 21 14:48:12.356260 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:12.356214 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9df5f159-58ca-4bc1-852e-05ff3dd191f5-workload-certs\") pod \"e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b\" (UID: \"9df5f159-58ca-4bc1-852e-05ff3dd191f5\") " pod="openshift-ingress/e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b" Jul 21 14:48:12.358127 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:12.358100 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9df5f159-58ca-4bc1-852e-05ff3dd191f5-istio-envoy\") pod \"e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b\" (UID: \"9df5f159-58ca-4bc1-852e-05ff3dd191f5\") " pod="openshift-ingress/e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b" Jul 21 14:48:12.358229 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:12.358189 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9df5f159-58ca-4bc1-852e-05ff3dd191f5-istio-podinfo\") pod \"e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b\" (UID: \"9df5f159-58ca-4bc1-852e-05ff3dd191f5\") " pod="openshift-ingress/e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b" Jul 21 14:48:12.365429 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:12.365404 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-44znh\" (UniqueName: \"kubernetes.io/projected/9df5f159-58ca-4bc1-852e-05ff3dd191f5-kube-api-access-44znh\") pod \"e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b\" (UID: \"9df5f159-58ca-4bc1-852e-05ff3dd191f5\") " pod="openshift-ingress/e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b" Jul 21 14:48:12.365546 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:12.365509 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9df5f159-58ca-4bc1-852e-05ff3dd191f5-istio-token\") pod \"e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b\" (UID: \"9df5f159-58ca-4bc1-852e-05ff3dd191f5\") " pod="openshift-ingress/e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b" Jul 21 14:48:12.489315 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:12.489290 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b" Jul 21 14:48:12.631590 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:12.631564 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b"] Jul 21 14:48:12.632445 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:48:12.632419 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9df5f159_58ca_4bc1_852e_05ff3dd191f5.slice/crio-efadc186e772984f586de815201156f3e7976cc3405fe26a2602ae733492790c WatchSource:0}: Error finding container efadc186e772984f586de815201156f3e7976cc3405fe26a2602ae733492790c: Status 404 returned error can't find the container with id efadc186e772984f586de815201156f3e7976cc3405fe26a2602ae733492790c Jul 21 14:48:12.634605 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:12.634576 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:48:12.634660 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:12.634637 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:48:12.634696 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:12.634689 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:48:13.163368 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:13.163331 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b" event={"ID":"9df5f159-58ca-4bc1-852e-05ff3dd191f5","Type":"ContainerStarted","Data":"aa168bc8191c44a22117a2bde0d94273b3d36cec8bd756a51ea6d4f8c8a4aa21"} Jul 21 14:48:13.163531 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:13.163388 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b" event={"ID":"9df5f159-58ca-4bc1-852e-05ff3dd191f5","Type":"ContainerStarted","Data":"efadc186e772984f586de815201156f3e7976cc3405fe26a2602ae733492790c"} Jul 21 14:48:13.194403 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:13.194361 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b" podStartSLOduration=1.194345871 podStartE2EDuration="1.194345871s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:48:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:48:13.192792795 +0000 UTC m=+1820.210696360" watchObservedRunningTime="2026-07-21 14:48:13.194345871 +0000 UTC m=+1820.212249444" Jul 21 14:48:13.490021 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:13.489996 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b" Jul 21 14:48:13.494732 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:13.494709 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b" Jul 21 14:48:14.169066 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:14.169040 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b" Jul 21 14:48:14.169942 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:14.169923 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b" Jul 21 14:48:16.680055 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:16.680032 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm" Jul 21 14:48:16.793446 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:16.793421 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7122299e-8d7b-411a-b68e-ea1e21082c23-credential-socket\") pod \"7122299e-8d7b-411a-b68e-ea1e21082c23\" (UID: \"7122299e-8d7b-411a-b68e-ea1e21082c23\") " Jul 21 14:48:16.793611 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:16.793480 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7122299e-8d7b-411a-b68e-ea1e21082c23-istio-data\") pod \"7122299e-8d7b-411a-b68e-ea1e21082c23\" (UID: \"7122299e-8d7b-411a-b68e-ea1e21082c23\") " Jul 21 14:48:16.793611 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:16.793520 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7122299e-8d7b-411a-b68e-ea1e21082c23-workload-certs\") pod \"7122299e-8d7b-411a-b68e-ea1e21082c23\" (UID: \"7122299e-8d7b-411a-b68e-ea1e21082c23\") " Jul 21 14:48:16.793611 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:16.793537 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7122299e-8d7b-411a-b68e-ea1e21082c23-istiod-ca-cert\") pod \"7122299e-8d7b-411a-b68e-ea1e21082c23\" (UID: \"7122299e-8d7b-411a-b68e-ea1e21082c23\") " Jul 21 14:48:16.793611 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:16.793567 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7122299e-8d7b-411a-b68e-ea1e21082c23-istio-podinfo\") pod \"7122299e-8d7b-411a-b68e-ea1e21082c23\" (UID: \"7122299e-8d7b-411a-b68e-ea1e21082c23\") " Jul 21 14:48:16.793611 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:16.793589 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j8xvw\" (UniqueName: \"kubernetes.io/projected/7122299e-8d7b-411a-b68e-ea1e21082c23-kube-api-access-j8xvw\") pod \"7122299e-8d7b-411a-b68e-ea1e21082c23\" (UID: \"7122299e-8d7b-411a-b68e-ea1e21082c23\") " Jul 21 14:48:16.793906 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:16.793630 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7122299e-8d7b-411a-b68e-ea1e21082c23-istio-token\") pod \"7122299e-8d7b-411a-b68e-ea1e21082c23\" (UID: \"7122299e-8d7b-411a-b68e-ea1e21082c23\") " Jul 21 14:48:16.793906 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:16.793659 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7122299e-8d7b-411a-b68e-ea1e21082c23-istio-envoy\") pod \"7122299e-8d7b-411a-b68e-ea1e21082c23\" (UID: \"7122299e-8d7b-411a-b68e-ea1e21082c23\") " Jul 21 14:48:16.793906 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:16.793696 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7122299e-8d7b-411a-b68e-ea1e21082c23-workload-socket\") pod \"7122299e-8d7b-411a-b68e-ea1e21082c23\" (UID: \"7122299e-8d7b-411a-b68e-ea1e21082c23\") " Jul 21 14:48:16.793906 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:16.793709 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7122299e-8d7b-411a-b68e-ea1e21082c23-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7122299e-8d7b-411a-b68e-ea1e21082c23" (UID: "7122299e-8d7b-411a-b68e-ea1e21082c23"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:48:16.793906 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:16.793856 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7122299e-8d7b-411a-b68e-ea1e21082c23-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7122299e-8d7b-411a-b68e-ea1e21082c23" (UID: "7122299e-8d7b-411a-b68e-ea1e21082c23"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:48:16.794170 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:16.793956 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7122299e-8d7b-411a-b68e-ea1e21082c23-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7122299e-8d7b-411a-b68e-ea1e21082c23" (UID: "7122299e-8d7b-411a-b68e-ea1e21082c23"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 14:48:16.794170 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:16.794098 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7122299e-8d7b-411a-b68e-ea1e21082c23-workload-certs\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:48:16.794170 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:16.794117 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7122299e-8d7b-411a-b68e-ea1e21082c23-istiod-ca-cert\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:48:16.794170 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:16.794123 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7122299e-8d7b-411a-b68e-ea1e21082c23-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7122299e-8d7b-411a-b68e-ea1e21082c23" (UID: "7122299e-8d7b-411a-b68e-ea1e21082c23"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:48:16.794170 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:16.794130 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7122299e-8d7b-411a-b68e-ea1e21082c23-credential-socket\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:48:16.794578 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:16.794536 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7122299e-8d7b-411a-b68e-ea1e21082c23-istio-data" (OuterVolumeSpecName: "istio-data") pod "7122299e-8d7b-411a-b68e-ea1e21082c23" (UID: "7122299e-8d7b-411a-b68e-ea1e21082c23"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:48:16.795934 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:16.795909 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7122299e-8d7b-411a-b68e-ea1e21082c23-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7122299e-8d7b-411a-b68e-ea1e21082c23" (UID: "7122299e-8d7b-411a-b68e-ea1e21082c23"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:48:16.796034 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:16.795932 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7122299e-8d7b-411a-b68e-ea1e21082c23-istio-token" (OuterVolumeSpecName: "istio-token") pod "7122299e-8d7b-411a-b68e-ea1e21082c23" (UID: "7122299e-8d7b-411a-b68e-ea1e21082c23"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 14:48:16.796034 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:16.795962 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7122299e-8d7b-411a-b68e-ea1e21082c23-kube-api-access-j8xvw" (OuterVolumeSpecName: "kube-api-access-j8xvw") pod "7122299e-8d7b-411a-b68e-ea1e21082c23" (UID: "7122299e-8d7b-411a-b68e-ea1e21082c23"). InnerVolumeSpecName "kube-api-access-j8xvw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 14:48:16.796111 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:16.796034 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7122299e-8d7b-411a-b68e-ea1e21082c23-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7122299e-8d7b-411a-b68e-ea1e21082c23" (UID: "7122299e-8d7b-411a-b68e-ea1e21082c23"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 21 14:48:16.895107 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:16.895084 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7122299e-8d7b-411a-b68e-ea1e21082c23-istio-data\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:48:16.895107 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:16.895106 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7122299e-8d7b-411a-b68e-ea1e21082c23-istio-podinfo\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:48:16.895234 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:16.895117 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j8xvw\" (UniqueName: \"kubernetes.io/projected/7122299e-8d7b-411a-b68e-ea1e21082c23-kube-api-access-j8xvw\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:48:16.895234 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:16.895125 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7122299e-8d7b-411a-b68e-ea1e21082c23-istio-token\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:48:16.895234 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:16.895135 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7122299e-8d7b-411a-b68e-ea1e21082c23-istio-envoy\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:48:16.895234 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:16.895143 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7122299e-8d7b-411a-b68e-ea1e21082c23-workload-socket\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:48:17.185325 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:17.185247 2576 generic.go:356] "Generic (PLEG): container finished" podID="7122299e-8d7b-411a-b68e-ea1e21082c23" containerID="32b7c172e06b2cb463ac92f9888808bb13e32ea363514e9d75780264e471b70d" exitCode=0 Jul 21 14:48:17.185325 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:17.185297 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm" Jul 21 14:48:17.185497 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:17.185332 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm" event={"ID":"7122299e-8d7b-411a-b68e-ea1e21082c23","Type":"ContainerDied","Data":"32b7c172e06b2cb463ac92f9888808bb13e32ea363514e9d75780264e471b70d"} Jul 21 14:48:17.185497 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:17.185383 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm" event={"ID":"7122299e-8d7b-411a-b68e-ea1e21082c23","Type":"ContainerDied","Data":"cdd9844e63d78900259771eca119a9091fc25b0be711485d7d6cec53dca2318a"} Jul 21 14:48:17.185497 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:17.185406 2576 scope.go:117] "RemoveContainer" containerID="32b7c172e06b2cb463ac92f9888808bb13e32ea363514e9d75780264e471b70d" Jul 21 14:48:17.197210 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:17.197176 2576 scope.go:117] "RemoveContainer" containerID="e9993a758dad0f18086a2d72fb43b66e163041b06205df947a7dd99f455fa998" Jul 21 14:48:17.205378 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:17.205357 2576 scope.go:117] "RemoveContainer" containerID="32b7c172e06b2cb463ac92f9888808bb13e32ea363514e9d75780264e471b70d" Jul 21 14:48:17.205620 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:48:17.205601 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32b7c172e06b2cb463ac92f9888808bb13e32ea363514e9d75780264e471b70d\": container with ID starting with 32b7c172e06b2cb463ac92f9888808bb13e32ea363514e9d75780264e471b70d not found: ID does not exist" containerID="32b7c172e06b2cb463ac92f9888808bb13e32ea363514e9d75780264e471b70d" Jul 21 14:48:17.205666 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:17.205630 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32b7c172e06b2cb463ac92f9888808bb13e32ea363514e9d75780264e471b70d"} err="failed to get container status \"32b7c172e06b2cb463ac92f9888808bb13e32ea363514e9d75780264e471b70d\": rpc error: code = NotFound desc = could not find container \"32b7c172e06b2cb463ac92f9888808bb13e32ea363514e9d75780264e471b70d\": container with ID starting with 32b7c172e06b2cb463ac92f9888808bb13e32ea363514e9d75780264e471b70d not found: ID does not exist" Jul 21 14:48:17.205666 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:17.205647 2576 scope.go:117] "RemoveContainer" containerID="e9993a758dad0f18086a2d72fb43b66e163041b06205df947a7dd99f455fa998" Jul 21 14:48:17.206040 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:48:17.206022 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9993a758dad0f18086a2d72fb43b66e163041b06205df947a7dd99f455fa998\": container with ID starting with e9993a758dad0f18086a2d72fb43b66e163041b06205df947a7dd99f455fa998 not found: ID does not exist" containerID="e9993a758dad0f18086a2d72fb43b66e163041b06205df947a7dd99f455fa998" Jul 21 14:48:17.206098 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:17.206045 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9993a758dad0f18086a2d72fb43b66e163041b06205df947a7dd99f455fa998"} err="failed to get container status \"e9993a758dad0f18086a2d72fb43b66e163041b06205df947a7dd99f455fa998\": rpc error: code = NotFound desc = could not find container \"e9993a758dad0f18086a2d72fb43b66e163041b06205df947a7dd99f455fa998\": container with ID starting with e9993a758dad0f18086a2d72fb43b66e163041b06205df947a7dd99f455fa998 not found: ID does not exist" Jul 21 14:48:17.216134 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:17.216114 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm"] Jul 21 14:48:17.224200 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:17.224179 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-0a74b282-openshift-default-dbf7b975-t46fm"] Jul 21 14:48:17.526004 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:17.525979 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7122299e-8d7b-411a-b68e-ea1e21082c23" path="/var/lib/kubelet/pods/7122299e-8d7b-411a-b68e-ea1e21082c23/volumes" Jul 21 14:48:29.170352 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:29.170316 2576 patch_prober.go:28] interesting pod/e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body= Jul 21 14:48:29.170857 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:29.170383 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b" podUID="9df5f159-58ca-4bc1-852e-05ff3dd191f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" Jul 21 14:48:29.257631 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:29.257602 2576 generic.go:356] "Generic (PLEG): container finished" podID="9df5f159-58ca-4bc1-852e-05ff3dd191f5" containerID="aa168bc8191c44a22117a2bde0d94273b3d36cec8bd756a51ea6d4f8c8a4aa21" exitCode=0 Jul 21 14:48:29.257764 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:29.257675 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b" event={"ID":"9df5f159-58ca-4bc1-852e-05ff3dd191f5","Type":"ContainerDied","Data":"aa168bc8191c44a22117a2bde0d94273b3d36cec8bd756a51ea6d4f8c8a4aa21"} Jul 21 14:48:29.258113 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:29.258094 2576 scope.go:117] "RemoveContainer" containerID="aa168bc8191c44a22117a2bde0d94273b3d36cec8bd756a51ea6d4f8c8a4aa21" Jul 21 14:48:29.259040 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:29.259011 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:48:29.259138 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:29.259079 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:48:29.259138 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:29.259121 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:48:30.265002 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:30.264968 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b" event={"ID":"9df5f159-58ca-4bc1-852e-05ff3dd191f5","Type":"ContainerStarted","Data":"6b12a38eb15191d89906291658e65f018f8f2e0ef09d7b2307da2def6fc76316"} Jul 21 14:48:30.489856 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:30.489825 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b" Jul 21 14:48:30.490162 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:30.490138 2576 patch_prober.go:28] interesting pod/e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body= Jul 21 14:48:30.490249 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:30.490198 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b" podUID="9df5f159-58ca-4bc1-852e-05ff3dd191f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" Jul 21 14:48:31.490492 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:31.490454 2576 patch_prober.go:28] interesting pod/e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body= Jul 21 14:48:31.490942 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:31.490520 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b" podUID="9df5f159-58ca-4bc1-852e-05ff3dd191f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" Jul 21 14:48:32.490084 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:32.490047 2576 patch_prober.go:28] interesting pod/e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body= Jul 21 14:48:32.490261 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:32.490112 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b" podUID="9df5f159-58ca-4bc1-852e-05ff3dd191f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" Jul 21 14:48:33.489999 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:33.489962 2576 patch_prober.go:28] interesting pod/e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body= Jul 21 14:48:33.490382 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:33.490014 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b" podUID="9df5f159-58ca-4bc1-852e-05ff3dd191f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" Jul 21 14:48:34.494215 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:34.494184 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b" Jul 21 14:48:34.494632 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:34.494590 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b" Jul 21 14:48:34.495320 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:34.495296 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b" Jul 21 14:48:54.733739 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:54.733700 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b"] Jul 21 14:48:54.734159 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:54.733965 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b" podUID="9df5f159-58ca-4bc1-852e-05ff3dd191f5" containerName="istio-proxy" containerID="cri-o://6b12a38eb15191d89906291658e65f018f8f2e0ef09d7b2307da2def6fc76316" gracePeriod=30 Jul 21 14:48:59.977174 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:48:59.977152 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b" Jul 21 14:49:00.063310 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:49:00.063248 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-44znh\" (UniqueName: \"kubernetes.io/projected/9df5f159-58ca-4bc1-852e-05ff3dd191f5-kube-api-access-44znh\") pod \"9df5f159-58ca-4bc1-852e-05ff3dd191f5\" (UID: \"9df5f159-58ca-4bc1-852e-05ff3dd191f5\") " Jul 21 14:49:00.063310 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:49:00.063296 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9df5f159-58ca-4bc1-852e-05ff3dd191f5-istiod-ca-cert\") pod \"9df5f159-58ca-4bc1-852e-05ff3dd191f5\" (UID: \"9df5f159-58ca-4bc1-852e-05ff3dd191f5\") " Jul 21 14:49:00.063462 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:49:00.063334 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9df5f159-58ca-4bc1-852e-05ff3dd191f5-istio-token\") pod \"9df5f159-58ca-4bc1-852e-05ff3dd191f5\" (UID: \"9df5f159-58ca-4bc1-852e-05ff3dd191f5\") " Jul 21 14:49:00.063462 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:49:00.063359 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9df5f159-58ca-4bc1-852e-05ff3dd191f5-istio-envoy\") pod \"9df5f159-58ca-4bc1-852e-05ff3dd191f5\" (UID: \"9df5f159-58ca-4bc1-852e-05ff3dd191f5\") " Jul 21 14:49:00.063462 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:49:00.063385 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9df5f159-58ca-4bc1-852e-05ff3dd191f5-workload-socket\") pod \"9df5f159-58ca-4bc1-852e-05ff3dd191f5\" (UID: \"9df5f159-58ca-4bc1-852e-05ff3dd191f5\") " Jul 21 14:49:00.063462 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:49:00.063420 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9df5f159-58ca-4bc1-852e-05ff3dd191f5-credential-socket\") pod \"9df5f159-58ca-4bc1-852e-05ff3dd191f5\" (UID: \"9df5f159-58ca-4bc1-852e-05ff3dd191f5\") " Jul 21 14:49:00.063647 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:49:00.063481 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9df5f159-58ca-4bc1-852e-05ff3dd191f5-istio-podinfo\") pod \"9df5f159-58ca-4bc1-852e-05ff3dd191f5\" (UID: \"9df5f159-58ca-4bc1-852e-05ff3dd191f5\") " Jul 21 14:49:00.063647 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:49:00.063508 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9df5f159-58ca-4bc1-852e-05ff3dd191f5-workload-certs\") pod \"9df5f159-58ca-4bc1-852e-05ff3dd191f5\" (UID: \"9df5f159-58ca-4bc1-852e-05ff3dd191f5\") " Jul 21 14:49:00.063647 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:49:00.063533 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9df5f159-58ca-4bc1-852e-05ff3dd191f5-istio-data\") pod \"9df5f159-58ca-4bc1-852e-05ff3dd191f5\" (UID: \"9df5f159-58ca-4bc1-852e-05ff3dd191f5\") " Jul 21 14:49:00.063828 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:49:00.063669 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9df5f159-58ca-4bc1-852e-05ff3dd191f5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9df5f159-58ca-4bc1-852e-05ff3dd191f5" (UID: "9df5f159-58ca-4bc1-852e-05ff3dd191f5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:49:00.063828 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:49:00.063750 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9df5f159-58ca-4bc1-852e-05ff3dd191f5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9df5f159-58ca-4bc1-852e-05ff3dd191f5" (UID: "9df5f159-58ca-4bc1-852e-05ff3dd191f5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 14:49:00.063828 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:49:00.063808 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9df5f159-58ca-4bc1-852e-05ff3dd191f5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9df5f159-58ca-4bc1-852e-05ff3dd191f5" (UID: "9df5f159-58ca-4bc1-852e-05ff3dd191f5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:49:00.063988 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:49:00.063968 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9df5f159-58ca-4bc1-852e-05ff3dd191f5-credential-socket\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:49:00.064044 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:49:00.063990 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9df5f159-58ca-4bc1-852e-05ff3dd191f5-istiod-ca-cert\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:49:00.064044 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:49:00.064004 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9df5f159-58ca-4bc1-852e-05ff3dd191f5-workload-socket\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:49:00.064044 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:49:00.063999 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9df5f159-58ca-4bc1-852e-05ff3dd191f5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9df5f159-58ca-4bc1-852e-05ff3dd191f5" (UID: "9df5f159-58ca-4bc1-852e-05ff3dd191f5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:49:00.064666 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:49:00.064641 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9df5f159-58ca-4bc1-852e-05ff3dd191f5-istio-data" (OuterVolumeSpecName: "istio-data") pod "9df5f159-58ca-4bc1-852e-05ff3dd191f5" (UID: "9df5f159-58ca-4bc1-852e-05ff3dd191f5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:49:00.065611 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:49:00.065588 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9df5f159-58ca-4bc1-852e-05ff3dd191f5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9df5f159-58ca-4bc1-852e-05ff3dd191f5" (UID: "9df5f159-58ca-4bc1-852e-05ff3dd191f5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:49:00.065710 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:49:00.065676 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9df5f159-58ca-4bc1-852e-05ff3dd191f5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9df5f159-58ca-4bc1-852e-05ff3dd191f5" (UID: "9df5f159-58ca-4bc1-852e-05ff3dd191f5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 21 14:49:00.065948 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:49:00.065929 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9df5f159-58ca-4bc1-852e-05ff3dd191f5-kube-api-access-44znh" (OuterVolumeSpecName: "kube-api-access-44znh") pod "9df5f159-58ca-4bc1-852e-05ff3dd191f5" (UID: "9df5f159-58ca-4bc1-852e-05ff3dd191f5"). InnerVolumeSpecName "kube-api-access-44znh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 14:49:00.066027 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:49:00.065955 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9df5f159-58ca-4bc1-852e-05ff3dd191f5-istio-token" (OuterVolumeSpecName: "istio-token") pod "9df5f159-58ca-4bc1-852e-05ff3dd191f5" (UID: "9df5f159-58ca-4bc1-852e-05ff3dd191f5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 14:49:00.164553 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:49:00.164529 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9df5f159-58ca-4bc1-852e-05ff3dd191f5-istio-envoy\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:49:00.164553 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:49:00.164548 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9df5f159-58ca-4bc1-852e-05ff3dd191f5-istio-podinfo\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:49:00.164685 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:49:00.164559 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9df5f159-58ca-4bc1-852e-05ff3dd191f5-workload-certs\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:49:00.164685 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:49:00.164567 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9df5f159-58ca-4bc1-852e-05ff3dd191f5-istio-data\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:49:00.164685 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:49:00.164575 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-44znh\" (UniqueName: \"kubernetes.io/projected/9df5f159-58ca-4bc1-852e-05ff3dd191f5-kube-api-access-44znh\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:49:00.164685 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:49:00.164583 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9df5f159-58ca-4bc1-852e-05ff3dd191f5-istio-token\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:49:00.428296 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:49:00.428225 2576 generic.go:356] "Generic (PLEG): container finished" podID="9df5f159-58ca-4bc1-852e-05ff3dd191f5" containerID="6b12a38eb15191d89906291658e65f018f8f2e0ef09d7b2307da2def6fc76316" exitCode=0 Jul 21 14:49:00.428296 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:49:00.428273 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b" Jul 21 14:49:00.428448 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:49:00.428318 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b" event={"ID":"9df5f159-58ca-4bc1-852e-05ff3dd191f5","Type":"ContainerDied","Data":"6b12a38eb15191d89906291658e65f018f8f2e0ef09d7b2307da2def6fc76316"} Jul 21 14:49:00.428448 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:49:00.428371 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b" event={"ID":"9df5f159-58ca-4bc1-852e-05ff3dd191f5","Type":"ContainerDied","Data":"efadc186e772984f586de815201156f3e7976cc3405fe26a2602ae733492790c"} Jul 21 14:49:00.428448 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:49:00.428395 2576 scope.go:117] "RemoveContainer" containerID="6b12a38eb15191d89906291658e65f018f8f2e0ef09d7b2307da2def6fc76316" Jul 21 14:49:00.437758 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:49:00.437743 2576 scope.go:117] "RemoveContainer" containerID="aa168bc8191c44a22117a2bde0d94273b3d36cec8bd756a51ea6d4f8c8a4aa21" Jul 21 14:49:00.445705 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:49:00.445690 2576 scope.go:117] "RemoveContainer" containerID="6b12a38eb15191d89906291658e65f018f8f2e0ef09d7b2307da2def6fc76316" Jul 21 14:49:00.445963 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:49:00.445941 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b12a38eb15191d89906291658e65f018f8f2e0ef09d7b2307da2def6fc76316\": container with ID starting with 6b12a38eb15191d89906291658e65f018f8f2e0ef09d7b2307da2def6fc76316 not found: ID does not exist" containerID="6b12a38eb15191d89906291658e65f018f8f2e0ef09d7b2307da2def6fc76316" Jul 21 14:49:00.446032 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:49:00.445969 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b12a38eb15191d89906291658e65f018f8f2e0ef09d7b2307da2def6fc76316"} err="failed to get container status \"6b12a38eb15191d89906291658e65f018f8f2e0ef09d7b2307da2def6fc76316\": rpc error: code = NotFound desc = could not find container \"6b12a38eb15191d89906291658e65f018f8f2e0ef09d7b2307da2def6fc76316\": container with ID starting with 6b12a38eb15191d89906291658e65f018f8f2e0ef09d7b2307da2def6fc76316 not found: ID does not exist" Jul 21 14:49:00.446032 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:49:00.445987 2576 scope.go:117] "RemoveContainer" containerID="aa168bc8191c44a22117a2bde0d94273b3d36cec8bd756a51ea6d4f8c8a4aa21" Jul 21 14:49:00.446212 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:49:00.446197 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa168bc8191c44a22117a2bde0d94273b3d36cec8bd756a51ea6d4f8c8a4aa21\": container with ID starting with aa168bc8191c44a22117a2bde0d94273b3d36cec8bd756a51ea6d4f8c8a4aa21 not found: ID does not exist" containerID="aa168bc8191c44a22117a2bde0d94273b3d36cec8bd756a51ea6d4f8c8a4aa21" Jul 21 14:49:00.446252 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:49:00.446218 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa168bc8191c44a22117a2bde0d94273b3d36cec8bd756a51ea6d4f8c8a4aa21"} err="failed to get container status \"aa168bc8191c44a22117a2bde0d94273b3d36cec8bd756a51ea6d4f8c8a4aa21\": rpc error: code = NotFound desc = could not find container \"aa168bc8191c44a22117a2bde0d94273b3d36cec8bd756a51ea6d4f8c8a4aa21\": container with ID starting with aa168bc8191c44a22117a2bde0d94273b3d36cec8bd756a51ea6d4f8c8a4aa21 not found: ID does not exist" Jul 21 14:49:00.455798 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:49:00.455760 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b"] Jul 21 14:49:00.464059 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:49:00.464039 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-e24b8b08-openshift-default-59fdd88db7-cpp2b"] Jul 21 14:49:01.526262 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:49:01.526234 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9df5f159-58ca-4bc1-852e-05ff3dd191f5" path="/var/lib/kubelet/pods/9df5f159-58ca-4bc1-852e-05ff3dd191f5/volumes" Jul 21 14:50:37.769929 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:50:37.769891 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2"] Jul 21 14:50:37.770385 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:50:37.770311 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7122299e-8d7b-411a-b68e-ea1e21082c23" containerName="istio-proxy" Jul 21 14:50:37.770385 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:50:37.770322 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7122299e-8d7b-411a-b68e-ea1e21082c23" containerName="istio-proxy" Jul 21 14:50:37.770385 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:50:37.770331 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9df5f159-58ca-4bc1-852e-05ff3dd191f5" containerName="istio-proxy" Jul 21 14:50:37.770385 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:50:37.770337 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9df5f159-58ca-4bc1-852e-05ff3dd191f5" containerName="istio-proxy" Jul 21 14:50:37.770385 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:50:37.770359 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9df5f159-58ca-4bc1-852e-05ff3dd191f5" containerName="istio-proxy" Jul 21 14:50:37.770385 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:50:37.770364 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9df5f159-58ca-4bc1-852e-05ff3dd191f5" containerName="istio-proxy" Jul 21 14:50:37.770618 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:50:37.770438 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7122299e-8d7b-411a-b68e-ea1e21082c23" containerName="istio-proxy" Jul 21 14:50:37.770618 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:50:37.770448 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9df5f159-58ca-4bc1-852e-05ff3dd191f5" containerName="istio-proxy" Jul 21 14:50:37.770618 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:50:37.770455 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7122299e-8d7b-411a-b68e-ea1e21082c23" containerName="istio-proxy" Jul 21 14:50:37.773560 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:50:37.773539 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2" Jul 21 14:50:37.776459 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:50:37.776431 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-15f01a6b-openshift-default-dockercfg-kbsql\"" Jul 21 14:50:37.808936 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:50:37.808902 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2"] Jul 21 14:50:37.935930 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:50:37.935874 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f04f24d-1616-4c92-be96-54f179aa0a1f-istio-podinfo\") pod \"e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2\" (UID: \"8f04f24d-1616-4c92-be96-54f179aa0a1f\") " pod="openshift-ingress/e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2" Jul 21 14:50:37.936134 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:50:37.935944 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f04f24d-1616-4c92-be96-54f179aa0a1f-istio-envoy\") pod \"e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2\" (UID: \"8f04f24d-1616-4c92-be96-54f179aa0a1f\") " pod="openshift-ingress/e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2" Jul 21 14:50:37.936134 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:50:37.935990 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2lmg\" (UniqueName: \"kubernetes.io/projected/8f04f24d-1616-4c92-be96-54f179aa0a1f-kube-api-access-p2lmg\") pod \"e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2\" (UID: \"8f04f24d-1616-4c92-be96-54f179aa0a1f\") " pod="openshift-ingress/e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2" Jul 21 14:50:37.936226 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:50:37.936146 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f04f24d-1616-4c92-be96-54f179aa0a1f-istiod-ca-cert\") pod \"e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2\" (UID: \"8f04f24d-1616-4c92-be96-54f179aa0a1f\") " pod="openshift-ingress/e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2" Jul 21 14:50:37.936268 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:50:37.936222 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f04f24d-1616-4c92-be96-54f179aa0a1f-workload-certs\") pod \"e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2\" (UID: \"8f04f24d-1616-4c92-be96-54f179aa0a1f\") " pod="openshift-ingress/e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2" Jul 21 14:50:37.936268 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:50:37.936258 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f04f24d-1616-4c92-be96-54f179aa0a1f-credential-socket\") pod \"e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2\" (UID: \"8f04f24d-1616-4c92-be96-54f179aa0a1f\") " pod="openshift-ingress/e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2" Jul 21 14:50:37.936353 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:50:37.936287 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f04f24d-1616-4c92-be96-54f179aa0a1f-istio-data\") pod \"e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2\" (UID: \"8f04f24d-1616-4c92-be96-54f179aa0a1f\") " pod="openshift-ingress/e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2" Jul 21 14:50:37.936353 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:50:37.936313 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f04f24d-1616-4c92-be96-54f179aa0a1f-istio-token\") pod \"e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2\" (UID: \"8f04f24d-1616-4c92-be96-54f179aa0a1f\") " pod="openshift-ingress/e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2" Jul 21 14:50:37.936437 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:50:37.936350 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f04f24d-1616-4c92-be96-54f179aa0a1f-workload-socket\") pod \"e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2\" (UID: \"8f04f24d-1616-4c92-be96-54f179aa0a1f\") " pod="openshift-ingress/e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2" Jul 21 14:50:38.037682 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:50:38.037575 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f04f24d-1616-4c92-be96-54f179aa0a1f-istio-podinfo\") pod \"e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2\" (UID: \"8f04f24d-1616-4c92-be96-54f179aa0a1f\") " pod="openshift-ingress/e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2" Jul 21 14:50:38.037682 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:50:38.037625 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f04f24d-1616-4c92-be96-54f179aa0a1f-istio-envoy\") pod \"e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2\" (UID: \"8f04f24d-1616-4c92-be96-54f179aa0a1f\") " pod="openshift-ingress/e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2" Jul 21 14:50:38.037940 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:50:38.037746 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2lmg\" (UniqueName: \"kubernetes.io/projected/8f04f24d-1616-4c92-be96-54f179aa0a1f-kube-api-access-p2lmg\") pod \"e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2\" (UID: \"8f04f24d-1616-4c92-be96-54f179aa0a1f\") " pod="openshift-ingress/e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2" Jul 21 14:50:38.037940 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:50:38.037886 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f04f24d-1616-4c92-be96-54f179aa0a1f-istiod-ca-cert\") pod \"e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2\" (UID: \"8f04f24d-1616-4c92-be96-54f179aa0a1f\") " pod="openshift-ingress/e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2" Jul 21 14:50:38.037940 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:50:38.037932 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f04f24d-1616-4c92-be96-54f179aa0a1f-workload-certs\") pod \"e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2\" (UID: \"8f04f24d-1616-4c92-be96-54f179aa0a1f\") " pod="openshift-ingress/e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2" Jul 21 14:50:38.038079 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:50:38.037952 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f04f24d-1616-4c92-be96-54f179aa0a1f-credential-socket\") pod \"e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2\" (UID: \"8f04f24d-1616-4c92-be96-54f179aa0a1f\") " pod="openshift-ingress/e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2" Jul 21 14:50:38.038142 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:50:38.038091 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f04f24d-1616-4c92-be96-54f179aa0a1f-istio-data\") pod \"e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2\" (UID: \"8f04f24d-1616-4c92-be96-54f179aa0a1f\") " pod="openshift-ingress/e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2" Jul 21 14:50:38.038203 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:50:38.038153 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f04f24d-1616-4c92-be96-54f179aa0a1f-istio-token\") pod \"e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2\" (UID: \"8f04f24d-1616-4c92-be96-54f179aa0a1f\") " pod="openshift-ingress/e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2" Jul 21 14:50:38.038261 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:50:38.038220 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f04f24d-1616-4c92-be96-54f179aa0a1f-workload-socket\") pod \"e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2\" (UID: \"8f04f24d-1616-4c92-be96-54f179aa0a1f\") " pod="openshift-ingress/e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2" Jul 21 14:50:38.038315 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:50:38.038291 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f04f24d-1616-4c92-be96-54f179aa0a1f-credential-socket\") pod \"e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2\" (UID: \"8f04f24d-1616-4c92-be96-54f179aa0a1f\") " pod="openshift-ingress/e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2" Jul 21 14:50:38.038367 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:50:38.038327 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f04f24d-1616-4c92-be96-54f179aa0a1f-workload-certs\") pod \"e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2\" (UID: \"8f04f24d-1616-4c92-be96-54f179aa0a1f\") " pod="openshift-ingress/e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2" Jul 21 14:50:38.038531 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:50:38.038500 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f04f24d-1616-4c92-be96-54f179aa0a1f-istio-data\") pod \"e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2\" (UID: \"8f04f24d-1616-4c92-be96-54f179aa0a1f\") " pod="openshift-ingress/e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2" Jul 21 14:50:38.038679 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:50:38.038662 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f04f24d-1616-4c92-be96-54f179aa0a1f-workload-socket\") pod \"e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2\" (UID: \"8f04f24d-1616-4c92-be96-54f179aa0a1f\") " pod="openshift-ingress/e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2" Jul 21 14:50:38.038747 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:50:38.038724 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f04f24d-1616-4c92-be96-54f179aa0a1f-istiod-ca-cert\") pod \"e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2\" (UID: \"8f04f24d-1616-4c92-be96-54f179aa0a1f\") " pod="openshift-ingress/e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2" Jul 21 14:50:38.040205 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:50:38.040178 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f04f24d-1616-4c92-be96-54f179aa0a1f-istio-envoy\") pod \"e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2\" (UID: \"8f04f24d-1616-4c92-be96-54f179aa0a1f\") " pod="openshift-ingress/e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2" Jul 21 14:50:38.040347 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:50:38.040327 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f04f24d-1616-4c92-be96-54f179aa0a1f-istio-podinfo\") pod \"e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2\" (UID: \"8f04f24d-1616-4c92-be96-54f179aa0a1f\") " pod="openshift-ingress/e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2" Jul 21 14:50:38.047725 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:50:38.047687 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f04f24d-1616-4c92-be96-54f179aa0a1f-istio-token\") pod \"e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2\" (UID: \"8f04f24d-1616-4c92-be96-54f179aa0a1f\") " pod="openshift-ingress/e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2" Jul 21 14:50:38.047725 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:50:38.047702 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2lmg\" (UniqueName: \"kubernetes.io/projected/8f04f24d-1616-4c92-be96-54f179aa0a1f-kube-api-access-p2lmg\") pod \"e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2\" (UID: \"8f04f24d-1616-4c92-be96-54f179aa0a1f\") " pod="openshift-ingress/e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2" Jul 21 14:50:38.084806 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:50:38.084736 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2" Jul 21 14:50:38.245825 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:50:38.245795 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2"] Jul 21 14:50:38.247546 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:50:38.247511 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f04f24d_1616_4c92_be96_54f179aa0a1f.slice/crio-825ba7ca881573515b2e598e69a8346ad9f23d9c9a07effba9ca87c83be27c2e WatchSource:0}: Error finding container 825ba7ca881573515b2e598e69a8346ad9f23d9c9a07effba9ca87c83be27c2e: Status 404 returned error can't find the container with id 825ba7ca881573515b2e598e69a8346ad9f23d9c9a07effba9ca87c83be27c2e Jul 21 14:50:38.250059 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:50:38.250020 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:50:38.250164 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:50:38.250092 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:50:38.250164 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:50:38.250130 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:50:38.964406 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:50:38.964370 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2" event={"ID":"8f04f24d-1616-4c92-be96-54f179aa0a1f","Type":"ContainerStarted","Data":"70f7124e0239848c3cb66fb56e6ecff0064f41ba1455cb843e6b30ea866ac63d"} Jul 21 14:50:38.964836 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:50:38.964426 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2" event={"ID":"8f04f24d-1616-4c92-be96-54f179aa0a1f","Type":"ContainerStarted","Data":"825ba7ca881573515b2e598e69a8346ad9f23d9c9a07effba9ca87c83be27c2e"} Jul 21 14:50:38.992683 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:50:38.992630 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2" podStartSLOduration=1.992611092 podStartE2EDuration="1.992611092s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:50:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:50:38.991951458 +0000 UTC m=+1966.009855032" watchObservedRunningTime="2026-07-21 14:50:38.992611092 +0000 UTC m=+1966.010514665" Jul 21 14:50:39.084956 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:50:39.084920 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2" Jul 21 14:50:39.090667 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:50:39.090641 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2" Jul 21 14:50:39.970166 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:50:39.970129 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2" Jul 21 14:50:39.971276 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:50:39.971256 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2" Jul 21 14:50:54.971586 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:50:54.971505 2576 patch_prober.go:28] interesting pod/e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body= Jul 21 14:50:54.971586 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:50:54.971564 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2" podUID="8f04f24d-1616-4c92-be96-54f179aa0a1f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" Jul 21 14:50:55.059361 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:50:55.059266 2576 generic.go:356] "Generic (PLEG): container finished" podID="8f04f24d-1616-4c92-be96-54f179aa0a1f" containerID="70f7124e0239848c3cb66fb56e6ecff0064f41ba1455cb843e6b30ea866ac63d" exitCode=0 Jul 21 14:50:55.059361 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:50:55.059339 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2" event={"ID":"8f04f24d-1616-4c92-be96-54f179aa0a1f","Type":"ContainerDied","Data":"70f7124e0239848c3cb66fb56e6ecff0064f41ba1455cb843e6b30ea866ac63d"} Jul 21 14:50:55.059805 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:50:55.059762 2576 scope.go:117] "RemoveContainer" containerID="70f7124e0239848c3cb66fb56e6ecff0064f41ba1455cb843e6b30ea866ac63d" Jul 21 14:50:55.066806 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:50:55.061543 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:50:55.066806 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:50:55.061713 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:50:55.066806 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:50:55.061832 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:50:56.067059 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:50:56.067021 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2" event={"ID":"8f04f24d-1616-4c92-be96-54f179aa0a1f","Type":"ContainerStarted","Data":"4006f9ccb00ae6d4320183bae143ec68c076e994adf44f58e4c19fa0a961c963"} Jul 21 14:50:56.085133 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:50:56.085104 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2" Jul 21 14:50:56.085287 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:50:56.085266 2576 patch_prober.go:28] interesting pod/e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body= Jul 21 14:50:56.085337 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:50:56.085311 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2" podUID="8f04f24d-1616-4c92-be96-54f179aa0a1f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" Jul 21 14:50:57.085329 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:50:57.085297 2576 patch_prober.go:28] interesting pod/e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body= Jul 21 14:50:57.085722 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:50:57.085362 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2" podUID="8f04f24d-1616-4c92-be96-54f179aa0a1f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" Jul 21 14:50:58.085424 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:50:58.085390 2576 patch_prober.go:28] interesting pod/e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body= Jul 21 14:50:58.085828 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:50:58.085453 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2" podUID="8f04f24d-1616-4c92-be96-54f179aa0a1f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" Jul 21 14:50:59.085965 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:50:59.085933 2576 patch_prober.go:28] interesting pod/e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body= Jul 21 14:50:59.086339 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:50:59.085986 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2" podUID="8f04f24d-1616-4c92-be96-54f179aa0a1f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" Jul 21 14:51:00.089525 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:00.089498 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2" Jul 21 14:51:00.089901 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:00.089744 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2" Jul 21 14:51:00.090345 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:00.090329 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2" Jul 21 14:51:15.895790 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:15.895739 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2"] Jul 21 14:51:15.896254 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:15.895978 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2" podUID="8f04f24d-1616-4c92-be96-54f179aa0a1f" containerName="istio-proxy" containerID="cri-o://4006f9ccb00ae6d4320183bae143ec68c076e994adf44f58e4c19fa0a961c963" gracePeriod=30 Jul 21 14:51:21.159281 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:21.159222 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2" Jul 21 14:51:21.199860 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:21.199827 2576 generic.go:356] "Generic (PLEG): container finished" podID="8f04f24d-1616-4c92-be96-54f179aa0a1f" containerID="4006f9ccb00ae6d4320183bae143ec68c076e994adf44f58e4c19fa0a961c963" exitCode=0 Jul 21 14:51:21.200037 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:21.199878 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2" Jul 21 14:51:21.200037 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:21.199909 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2" event={"ID":"8f04f24d-1616-4c92-be96-54f179aa0a1f","Type":"ContainerDied","Data":"4006f9ccb00ae6d4320183bae143ec68c076e994adf44f58e4c19fa0a961c963"} Jul 21 14:51:21.200037 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:21.199963 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2" event={"ID":"8f04f24d-1616-4c92-be96-54f179aa0a1f","Type":"ContainerDied","Data":"825ba7ca881573515b2e598e69a8346ad9f23d9c9a07effba9ca87c83be27c2e"} Jul 21 14:51:21.200037 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:21.199987 2576 scope.go:117] "RemoveContainer" containerID="4006f9ccb00ae6d4320183bae143ec68c076e994adf44f58e4c19fa0a961c963" Jul 21 14:51:21.208962 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:21.208937 2576 scope.go:117] "RemoveContainer" containerID="70f7124e0239848c3cb66fb56e6ecff0064f41ba1455cb843e6b30ea866ac63d" Jul 21 14:51:21.217548 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:21.217529 2576 scope.go:117] "RemoveContainer" containerID="4006f9ccb00ae6d4320183bae143ec68c076e994adf44f58e4c19fa0a961c963" Jul 21 14:51:21.217853 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:51:21.217835 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4006f9ccb00ae6d4320183bae143ec68c076e994adf44f58e4c19fa0a961c963\": container with ID starting with 4006f9ccb00ae6d4320183bae143ec68c076e994adf44f58e4c19fa0a961c963 not found: ID does not exist" containerID="4006f9ccb00ae6d4320183bae143ec68c076e994adf44f58e4c19fa0a961c963" Jul 21 14:51:21.217929 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:21.217863 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4006f9ccb00ae6d4320183bae143ec68c076e994adf44f58e4c19fa0a961c963"} err="failed to get container status \"4006f9ccb00ae6d4320183bae143ec68c076e994adf44f58e4c19fa0a961c963\": rpc error: code = NotFound desc = could not find container \"4006f9ccb00ae6d4320183bae143ec68c076e994adf44f58e4c19fa0a961c963\": container with ID starting with 4006f9ccb00ae6d4320183bae143ec68c076e994adf44f58e4c19fa0a961c963 not found: ID does not exist" Jul 21 14:51:21.217929 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:21.217881 2576 scope.go:117] "RemoveContainer" containerID="70f7124e0239848c3cb66fb56e6ecff0064f41ba1455cb843e6b30ea866ac63d" Jul 21 14:51:21.218112 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:51:21.218097 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70f7124e0239848c3cb66fb56e6ecff0064f41ba1455cb843e6b30ea866ac63d\": container with ID starting with 70f7124e0239848c3cb66fb56e6ecff0064f41ba1455cb843e6b30ea866ac63d not found: ID does not exist" containerID="70f7124e0239848c3cb66fb56e6ecff0064f41ba1455cb843e6b30ea866ac63d" Jul 21 14:51:21.218148 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:21.218114 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70f7124e0239848c3cb66fb56e6ecff0064f41ba1455cb843e6b30ea866ac63d"} err="failed to get container status \"70f7124e0239848c3cb66fb56e6ecff0064f41ba1455cb843e6b30ea866ac63d\": rpc error: code = NotFound desc = could not find container \"70f7124e0239848c3cb66fb56e6ecff0064f41ba1455cb843e6b30ea866ac63d\": container with ID starting with 70f7124e0239848c3cb66fb56e6ecff0064f41ba1455cb843e6b30ea866ac63d not found: ID does not exist" Jul 21 14:51:21.337361 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:21.337331 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f04f24d-1616-4c92-be96-54f179aa0a1f-istio-token\") pod \"8f04f24d-1616-4c92-be96-54f179aa0a1f\" (UID: \"8f04f24d-1616-4c92-be96-54f179aa0a1f\") " Jul 21 14:51:21.337563 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:21.337373 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f04f24d-1616-4c92-be96-54f179aa0a1f-istio-envoy\") pod \"8f04f24d-1616-4c92-be96-54f179aa0a1f\" (UID: \"8f04f24d-1616-4c92-be96-54f179aa0a1f\") " Jul 21 14:51:21.337563 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:21.337393 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f04f24d-1616-4c92-be96-54f179aa0a1f-credential-socket\") pod \"8f04f24d-1616-4c92-be96-54f179aa0a1f\" (UID: \"8f04f24d-1616-4c92-be96-54f179aa0a1f\") " Jul 21 14:51:21.337563 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:21.337483 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f04f24d-1616-4c92-be96-54f179aa0a1f-workload-certs\") pod \"8f04f24d-1616-4c92-be96-54f179aa0a1f\" (UID: \"8f04f24d-1616-4c92-be96-54f179aa0a1f\") " Jul 21 14:51:21.337563 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:21.337530 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f04f24d-1616-4c92-be96-54f179aa0a1f-istiod-ca-cert\") pod \"8f04f24d-1616-4c92-be96-54f179aa0a1f\" (UID: \"8f04f24d-1616-4c92-be96-54f179aa0a1f\") " Jul 21 14:51:21.337806 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:21.337591 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f04f24d-1616-4c92-be96-54f179aa0a1f-istio-data\") pod \"8f04f24d-1616-4c92-be96-54f179aa0a1f\" (UID: \"8f04f24d-1616-4c92-be96-54f179aa0a1f\") " Jul 21 14:51:21.337806 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:21.337620 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p2lmg\" (UniqueName: \"kubernetes.io/projected/8f04f24d-1616-4c92-be96-54f179aa0a1f-kube-api-access-p2lmg\") pod \"8f04f24d-1616-4c92-be96-54f179aa0a1f\" (UID: \"8f04f24d-1616-4c92-be96-54f179aa0a1f\") " Jul 21 14:51:21.337806 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:21.337670 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f04f24d-1616-4c92-be96-54f179aa0a1f-workload-socket\") pod \"8f04f24d-1616-4c92-be96-54f179aa0a1f\" (UID: \"8f04f24d-1616-4c92-be96-54f179aa0a1f\") " Jul 21 14:51:21.337806 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:21.337709 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f04f24d-1616-4c92-be96-54f179aa0a1f-istio-podinfo\") pod \"8f04f24d-1616-4c92-be96-54f179aa0a1f\" (UID: \"8f04f24d-1616-4c92-be96-54f179aa0a1f\") " Jul 21 14:51:21.337806 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:21.337716 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f04f24d-1616-4c92-be96-54f179aa0a1f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8f04f24d-1616-4c92-be96-54f179aa0a1f" (UID: "8f04f24d-1616-4c92-be96-54f179aa0a1f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:51:21.338073 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:21.337809 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f04f24d-1616-4c92-be96-54f179aa0a1f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8f04f24d-1616-4c92-be96-54f179aa0a1f" (UID: "8f04f24d-1616-4c92-be96-54f179aa0a1f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:51:21.338073 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:21.337978 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f04f24d-1616-4c92-be96-54f179aa0a1f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8f04f24d-1616-4c92-be96-54f179aa0a1f" (UID: "8f04f24d-1616-4c92-be96-54f179aa0a1f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:51:21.338203 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:21.338174 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f04f24d-1616-4c92-be96-54f179aa0a1f-workload-certs\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:51:21.338258 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:21.338209 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f04f24d-1616-4c92-be96-54f179aa0a1f-workload-socket\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:51:21.338258 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:21.338224 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f04f24d-1616-4c92-be96-54f179aa0a1f-credential-socket\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:51:21.338364 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:21.338268 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f04f24d-1616-4c92-be96-54f179aa0a1f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8f04f24d-1616-4c92-be96-54f179aa0a1f" (UID: "8f04f24d-1616-4c92-be96-54f179aa0a1f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 14:51:21.338535 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:21.338504 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f04f24d-1616-4c92-be96-54f179aa0a1f-istio-data" (OuterVolumeSpecName: "istio-data") pod "8f04f24d-1616-4c92-be96-54f179aa0a1f" (UID: "8f04f24d-1616-4c92-be96-54f179aa0a1f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:51:21.339830 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:21.339800 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f04f24d-1616-4c92-be96-54f179aa0a1f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8f04f24d-1616-4c92-be96-54f179aa0a1f" (UID: "8f04f24d-1616-4c92-be96-54f179aa0a1f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:51:21.339830 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:21.339817 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8f04f24d-1616-4c92-be96-54f179aa0a1f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8f04f24d-1616-4c92-be96-54f179aa0a1f" (UID: "8f04f24d-1616-4c92-be96-54f179aa0a1f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 21 14:51:21.339962 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:21.339842 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f04f24d-1616-4c92-be96-54f179aa0a1f-istio-token" (OuterVolumeSpecName: "istio-token") pod "8f04f24d-1616-4c92-be96-54f179aa0a1f" (UID: "8f04f24d-1616-4c92-be96-54f179aa0a1f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 14:51:21.339962 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:21.339866 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f04f24d-1616-4c92-be96-54f179aa0a1f-kube-api-access-p2lmg" (OuterVolumeSpecName: "kube-api-access-p2lmg") pod "8f04f24d-1616-4c92-be96-54f179aa0a1f" (UID: "8f04f24d-1616-4c92-be96-54f179aa0a1f"). InnerVolumeSpecName "kube-api-access-p2lmg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 14:51:21.439593 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:21.439504 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f04f24d-1616-4c92-be96-54f179aa0a1f-istio-data\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:51:21.439593 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:21.439535 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p2lmg\" (UniqueName: \"kubernetes.io/projected/8f04f24d-1616-4c92-be96-54f179aa0a1f-kube-api-access-p2lmg\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:51:21.439593 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:21.439545 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f04f24d-1616-4c92-be96-54f179aa0a1f-istio-podinfo\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:51:21.439593 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:21.439555 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f04f24d-1616-4c92-be96-54f179aa0a1f-istio-token\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:51:21.439593 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:21.439564 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f04f24d-1616-4c92-be96-54f179aa0a1f-istio-envoy\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:51:21.439593 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:21.439574 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f04f24d-1616-4c92-be96-54f179aa0a1f-istiod-ca-cert\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:51:21.534505 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:21.534474 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2"] Jul 21 14:51:21.534505 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:21.534511 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-15f01a6b-openshift-default-5c8f4c48d7-zjwt2"] Jul 21 14:51:23.526079 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:23.526042 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f04f24d-1616-4c92-be96-54f179aa0a1f" path="/var/lib/kubelet/pods/8f04f24d-1616-4c92-be96-54f179aa0a1f/volumes" Jul 21 14:51:36.484407 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:36.484363 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx"] Jul 21 14:51:36.484854 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:36.484835 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f04f24d-1616-4c92-be96-54f179aa0a1f" containerName="istio-proxy" Jul 21 14:51:36.484854 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:36.484848 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f04f24d-1616-4c92-be96-54f179aa0a1f" containerName="istio-proxy" Jul 21 14:51:36.484935 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:36.484881 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f04f24d-1616-4c92-be96-54f179aa0a1f" containerName="istio-proxy" Jul 21 14:51:36.484935 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:36.484887 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f04f24d-1616-4c92-be96-54f179aa0a1f" containerName="istio-proxy" Jul 21 14:51:36.484935 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:36.484895 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7122299e-8d7b-411a-b68e-ea1e21082c23" containerName="istio-proxy" Jul 21 14:51:36.484935 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:36.484900 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7122299e-8d7b-411a-b68e-ea1e21082c23" containerName="istio-proxy" Jul 21 14:51:36.485059 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:36.484977 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9df5f159-58ca-4bc1-852e-05ff3dd191f5" containerName="istio-proxy" Jul 21 14:51:36.485059 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:36.484987 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f04f24d-1616-4c92-be96-54f179aa0a1f" containerName="istio-proxy" Jul 21 14:51:36.485059 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:36.484995 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f04f24d-1616-4c92-be96-54f179aa0a1f" containerName="istio-proxy" Jul 21 14:51:36.487285 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:36.487262 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx" Jul 21 14:51:36.491024 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:36.490994 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-02afa090-openshift-default-dockercfg-xbqzx\"" Jul 21 14:51:36.504020 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:36.503984 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx"] Jul 21 14:51:36.589638 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:36.589593 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/255f033b-4be6-4f1e-9538-96d541a748b8-workload-certs\") pod \"e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx\" (UID: \"255f033b-4be6-4f1e-9538-96d541a748b8\") " pod="openshift-ingress/e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx" Jul 21 14:51:36.589892 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:36.589654 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/255f033b-4be6-4f1e-9538-96d541a748b8-workload-socket\") pod \"e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx\" (UID: \"255f033b-4be6-4f1e-9538-96d541a748b8\") " pod="openshift-ingress/e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx" Jul 21 14:51:36.589892 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:36.589759 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/255f033b-4be6-4f1e-9538-96d541a748b8-istio-data\") pod \"e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx\" (UID: \"255f033b-4be6-4f1e-9538-96d541a748b8\") " pod="openshift-ingress/e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx" Jul 21 14:51:36.589892 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:36.589819 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/255f033b-4be6-4f1e-9538-96d541a748b8-istio-token\") pod \"e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx\" (UID: \"255f033b-4be6-4f1e-9538-96d541a748b8\") " pod="openshift-ingress/e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx" Jul 21 14:51:36.589892 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:36.589860 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/255f033b-4be6-4f1e-9538-96d541a748b8-istio-envoy\") pod \"e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx\" (UID: \"255f033b-4be6-4f1e-9538-96d541a748b8\") " pod="openshift-ingress/e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx" Jul 21 14:51:36.590126 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:36.589948 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/255f033b-4be6-4f1e-9538-96d541a748b8-istio-podinfo\") pod \"e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx\" (UID: \"255f033b-4be6-4f1e-9538-96d541a748b8\") " pod="openshift-ingress/e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx" Jul 21 14:51:36.590126 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:36.589981 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hsvp\" (UniqueName: \"kubernetes.io/projected/255f033b-4be6-4f1e-9538-96d541a748b8-kube-api-access-4hsvp\") pod \"e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx\" (UID: \"255f033b-4be6-4f1e-9538-96d541a748b8\") " pod="openshift-ingress/e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx" Jul 21 14:51:36.590126 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:36.590034 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/255f033b-4be6-4f1e-9538-96d541a748b8-credential-socket\") pod \"e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx\" (UID: \"255f033b-4be6-4f1e-9538-96d541a748b8\") " pod="openshift-ingress/e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx" Jul 21 14:51:36.590126 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:36.590087 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/255f033b-4be6-4f1e-9538-96d541a748b8-istiod-ca-cert\") pod \"e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx\" (UID: \"255f033b-4be6-4f1e-9538-96d541a748b8\") " pod="openshift-ingress/e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx" Jul 21 14:51:36.691407 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:36.691364 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/255f033b-4be6-4f1e-9538-96d541a748b8-workload-certs\") pod \"e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx\" (UID: \"255f033b-4be6-4f1e-9538-96d541a748b8\") " pod="openshift-ingress/e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx" Jul 21 14:51:36.691632 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:36.691416 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/255f033b-4be6-4f1e-9538-96d541a748b8-workload-socket\") pod \"e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx\" (UID: \"255f033b-4be6-4f1e-9538-96d541a748b8\") " pod="openshift-ingress/e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx" Jul 21 14:51:36.691632 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:36.691446 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/255f033b-4be6-4f1e-9538-96d541a748b8-istio-data\") pod \"e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx\" (UID: \"255f033b-4be6-4f1e-9538-96d541a748b8\") " pod="openshift-ingress/e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx" Jul 21 14:51:36.691632 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:36.691466 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/255f033b-4be6-4f1e-9538-96d541a748b8-istio-token\") pod \"e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx\" (UID: \"255f033b-4be6-4f1e-9538-96d541a748b8\") " pod="openshift-ingress/e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx" Jul 21 14:51:36.691632 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:36.691491 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/255f033b-4be6-4f1e-9538-96d541a748b8-istio-envoy\") pod \"e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx\" (UID: \"255f033b-4be6-4f1e-9538-96d541a748b8\") " pod="openshift-ingress/e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx" Jul 21 14:51:36.691632 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:36.691536 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/255f033b-4be6-4f1e-9538-96d541a748b8-istio-podinfo\") pod \"e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx\" (UID: \"255f033b-4be6-4f1e-9538-96d541a748b8\") " pod="openshift-ingress/e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx" Jul 21 14:51:36.691632 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:36.691557 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hsvp\" (UniqueName: \"kubernetes.io/projected/255f033b-4be6-4f1e-9538-96d541a748b8-kube-api-access-4hsvp\") pod \"e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx\" (UID: \"255f033b-4be6-4f1e-9538-96d541a748b8\") " pod="openshift-ingress/e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx" Jul 21 14:51:36.691632 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:36.691601 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/255f033b-4be6-4f1e-9538-96d541a748b8-credential-socket\") pod \"e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx\" (UID: \"255f033b-4be6-4f1e-9538-96d541a748b8\") " pod="openshift-ingress/e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx" Jul 21 14:51:36.692137 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:36.691637 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/255f033b-4be6-4f1e-9538-96d541a748b8-istiod-ca-cert\") pod \"e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx\" (UID: \"255f033b-4be6-4f1e-9538-96d541a748b8\") " pod="openshift-ingress/e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx" Jul 21 14:51:36.692137 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:36.692009 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/255f033b-4be6-4f1e-9538-96d541a748b8-workload-socket\") pod \"e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx\" (UID: \"255f033b-4be6-4f1e-9538-96d541a748b8\") " pod="openshift-ingress/e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx" Jul 21 14:51:36.692137 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:36.692037 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/255f033b-4be6-4f1e-9538-96d541a748b8-istio-data\") pod \"e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx\" (UID: \"255f033b-4be6-4f1e-9538-96d541a748b8\") " pod="openshift-ingress/e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx" Jul 21 14:51:36.692137 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:36.692120 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/255f033b-4be6-4f1e-9538-96d541a748b8-workload-certs\") pod \"e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx\" (UID: \"255f033b-4be6-4f1e-9538-96d541a748b8\") " pod="openshift-ingress/e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx" Jul 21 14:51:36.692281 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:36.692224 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/255f033b-4be6-4f1e-9538-96d541a748b8-credential-socket\") pod \"e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx\" (UID: \"255f033b-4be6-4f1e-9538-96d541a748b8\") " pod="openshift-ingress/e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx" Jul 21 14:51:36.692450 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:36.692432 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/255f033b-4be6-4f1e-9538-96d541a748b8-istiod-ca-cert\") pod \"e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx\" (UID: \"255f033b-4be6-4f1e-9538-96d541a748b8\") " pod="openshift-ingress/e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx" Jul 21 14:51:36.694233 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:36.694208 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/255f033b-4be6-4f1e-9538-96d541a748b8-istio-envoy\") pod \"e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx\" (UID: \"255f033b-4be6-4f1e-9538-96d541a748b8\") " pod="openshift-ingress/e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx" Jul 21 14:51:36.694361 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:36.694333 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/255f033b-4be6-4f1e-9538-96d541a748b8-istio-podinfo\") pod \"e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx\" (UID: \"255f033b-4be6-4f1e-9538-96d541a748b8\") " pod="openshift-ingress/e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx" Jul 21 14:51:36.701100 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:36.701071 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/255f033b-4be6-4f1e-9538-96d541a748b8-istio-token\") pod \"e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx\" (UID: \"255f033b-4be6-4f1e-9538-96d541a748b8\") " pod="openshift-ingress/e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx" Jul 21 14:51:36.701230 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:36.701155 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hsvp\" (UniqueName: \"kubernetes.io/projected/255f033b-4be6-4f1e-9538-96d541a748b8-kube-api-access-4hsvp\") pod \"e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx\" (UID: \"255f033b-4be6-4f1e-9538-96d541a748b8\") " pod="openshift-ingress/e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx" Jul 21 14:51:36.797555 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:36.797508 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx" Jul 21 14:51:36.949095 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:36.949056 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx"] Jul 21 14:51:36.951501 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:51:36.951463 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod255f033b_4be6_4f1e_9538_96d541a748b8.slice/crio-8a822c0f3607358d714124683e19aefa199f2e7d201fef36b5b7bceb0631a4a1 WatchSource:0}: Error finding container 8a822c0f3607358d714124683e19aefa199f2e7d201fef36b5b7bceb0631a4a1: Status 404 returned error can't find the container with id 8a822c0f3607358d714124683e19aefa199f2e7d201fef36b5b7bceb0631a4a1 Jul 21 14:51:36.954204 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:36.954164 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:51:36.954344 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:36.954259 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:51:36.954344 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:36.954307 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:51:37.292860 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:37.292818 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx" event={"ID":"255f033b-4be6-4f1e-9538-96d541a748b8","Type":"ContainerStarted","Data":"c7aecd9b4d96cccd4c8d13396101fae0377b4e7384cce275604d1fc94e09f2a9"} Jul 21 14:51:37.293061 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:37.292891 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx" event={"ID":"255f033b-4be6-4f1e-9538-96d541a748b8","Type":"ContainerStarted","Data":"8a822c0f3607358d714124683e19aefa199f2e7d201fef36b5b7bceb0631a4a1"} Jul 21 14:51:37.322769 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:37.322712 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx" podStartSLOduration=1.322691925 podStartE2EDuration="1.322691925s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:51:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:51:37.320640904 +0000 UTC m=+2024.338544481" watchObservedRunningTime="2026-07-21 14:51:37.322691925 +0000 UTC m=+2024.340595501" Jul 21 14:51:37.797690 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:37.797647 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx" Jul 21 14:51:38.803180 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:38.803147 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx" Jul 21 14:51:39.304543 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:39.304513 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx" Jul 21 14:51:39.305570 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:39.305553 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx" Jul 21 14:51:52.382127 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:52.382093 2576 generic.go:356] "Generic (PLEG): container finished" podID="255f033b-4be6-4f1e-9538-96d541a748b8" containerID="c7aecd9b4d96cccd4c8d13396101fae0377b4e7384cce275604d1fc94e09f2a9" exitCode=0 Jul 21 14:51:52.382127 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:52.382135 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx" event={"ID":"255f033b-4be6-4f1e-9538-96d541a748b8","Type":"ContainerDied","Data":"c7aecd9b4d96cccd4c8d13396101fae0377b4e7384cce275604d1fc94e09f2a9"} Jul 21 14:51:52.382621 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:52.382549 2576 scope.go:117] "RemoveContainer" containerID="c7aecd9b4d96cccd4c8d13396101fae0377b4e7384cce275604d1fc94e09f2a9" Jul 21 14:51:52.384596 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:52.384065 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:51:52.384596 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:52.384279 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:51:52.384596 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:52.384384 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:51:53.389538 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:53.389497 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx" event={"ID":"255f033b-4be6-4f1e-9538-96d541a748b8","Type":"ContainerStarted","Data":"30b6ad61c520da22633f26a3c877c52ef0cad804281b9771bb17922dc7c89ece"} Jul 21 14:51:53.812067 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:53.811998 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx" Jul 21 14:51:53.813363 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:53.813325 2576 patch_prober.go:28] interesting pod/e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body= Jul 21 14:51:53.813527 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:53.813399 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx" podUID="255f033b-4be6-4f1e-9538-96d541a748b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" Jul 21 14:51:54.305466 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:54.305408 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx" Jul 21 14:51:54.799028 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:54.798982 2576 patch_prober.go:28] interesting pod/e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body= Jul 21 14:51:54.799730 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:54.799687 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx" podUID="255f033b-4be6-4f1e-9538-96d541a748b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" Jul 21 14:51:55.798685 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:55.798634 2576 patch_prober.go:28] interesting pod/e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body= Jul 21 14:51:55.798956 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:55.798711 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx" podUID="255f033b-4be6-4f1e-9538-96d541a748b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" Jul 21 14:51:56.799714 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:56.799670 2576 patch_prober.go:28] interesting pod/e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body= Jul 21 14:51:56.800254 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:56.799744 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx" podUID="255f033b-4be6-4f1e-9538-96d541a748b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" Jul 21 14:51:57.802567 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:57.802532 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx" Jul 21 14:51:57.803887 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:51:57.803866 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx" Jul 21 14:53:34.758144 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:53:34.758100 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx"] Jul 21 14:53:34.758652 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:53:34.758393 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx" podUID="255f033b-4be6-4f1e-9538-96d541a748b8" containerName="istio-proxy" containerID="cri-o://30b6ad61c520da22633f26a3c877c52ef0cad804281b9771bb17922dc7c89ece" gracePeriod=30 Jul 21 14:53:39.989888 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:53:39.989855 2576 generic.go:356] "Generic (PLEG): container finished" podID="255f033b-4be6-4f1e-9538-96d541a748b8" containerID="30b6ad61c520da22633f26a3c877c52ef0cad804281b9771bb17922dc7c89ece" exitCode=0 Jul 21 14:53:39.990338 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:53:39.989924 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx" event={"ID":"255f033b-4be6-4f1e-9538-96d541a748b8","Type":"ContainerDied","Data":"30b6ad61c520da22633f26a3c877c52ef0cad804281b9771bb17922dc7c89ece"} Jul 21 14:53:39.990338 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:53:39.989988 2576 scope.go:117] "RemoveContainer" containerID="c7aecd9b4d96cccd4c8d13396101fae0377b4e7384cce275604d1fc94e09f2a9" Jul 21 14:53:40.015462 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:53:40.015437 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx" Jul 21 14:53:40.097803 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:53:40.097673 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/255f033b-4be6-4f1e-9538-96d541a748b8-credential-socket\") pod \"255f033b-4be6-4f1e-9538-96d541a748b8\" (UID: \"255f033b-4be6-4f1e-9538-96d541a748b8\") " Jul 21 14:53:40.097803 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:53:40.097804 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/255f033b-4be6-4f1e-9538-96d541a748b8-istiod-ca-cert\") pod \"255f033b-4be6-4f1e-9538-96d541a748b8\" (UID: \"255f033b-4be6-4f1e-9538-96d541a748b8\") " Jul 21 14:53:40.098014 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:53:40.097837 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/255f033b-4be6-4f1e-9538-96d541a748b8-istio-podinfo\") pod \"255f033b-4be6-4f1e-9538-96d541a748b8\" (UID: \"255f033b-4be6-4f1e-9538-96d541a748b8\") " Jul 21 14:53:40.098014 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:53:40.097885 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/255f033b-4be6-4f1e-9538-96d541a748b8-istio-data\") pod \"255f033b-4be6-4f1e-9538-96d541a748b8\" (UID: \"255f033b-4be6-4f1e-9538-96d541a748b8\") " Jul 21 14:53:40.098014 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:53:40.097913 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/255f033b-4be6-4f1e-9538-96d541a748b8-workload-socket\") pod \"255f033b-4be6-4f1e-9538-96d541a748b8\" (UID: \"255f033b-4be6-4f1e-9538-96d541a748b8\") " Jul 21 14:53:40.098014 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:53:40.097957 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4hsvp\" (UniqueName: \"kubernetes.io/projected/255f033b-4be6-4f1e-9538-96d541a748b8-kube-api-access-4hsvp\") pod \"255f033b-4be6-4f1e-9538-96d541a748b8\" (UID: \"255f033b-4be6-4f1e-9538-96d541a748b8\") " Jul 21 14:53:40.098014 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:53:40.097983 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/255f033b-4be6-4f1e-9538-96d541a748b8-istio-token\") pod \"255f033b-4be6-4f1e-9538-96d541a748b8\" (UID: \"255f033b-4be6-4f1e-9538-96d541a748b8\") " Jul 21 14:53:40.098014 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:53:40.098011 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/255f033b-4be6-4f1e-9538-96d541a748b8-workload-certs\") pod \"255f033b-4be6-4f1e-9538-96d541a748b8\" (UID: \"255f033b-4be6-4f1e-9538-96d541a748b8\") " Jul 21 14:53:40.098385 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:53:40.098038 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/255f033b-4be6-4f1e-9538-96d541a748b8-istio-envoy\") pod \"255f033b-4be6-4f1e-9538-96d541a748b8\" (UID: \"255f033b-4be6-4f1e-9538-96d541a748b8\") " Jul 21 14:53:40.098385 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:53:40.098034 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/255f033b-4be6-4f1e-9538-96d541a748b8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "255f033b-4be6-4f1e-9538-96d541a748b8" (UID: "255f033b-4be6-4f1e-9538-96d541a748b8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:53:40.098385 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:53:40.098233 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/255f033b-4be6-4f1e-9538-96d541a748b8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "255f033b-4be6-4f1e-9538-96d541a748b8" (UID: "255f033b-4be6-4f1e-9538-96d541a748b8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 14:53:40.098385 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:53:40.098293 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/255f033b-4be6-4f1e-9538-96d541a748b8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "255f033b-4be6-4f1e-9538-96d541a748b8" (UID: "255f033b-4be6-4f1e-9538-96d541a748b8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:53:40.098385 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:53:40.098309 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/255f033b-4be6-4f1e-9538-96d541a748b8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "255f033b-4be6-4f1e-9538-96d541a748b8" (UID: "255f033b-4be6-4f1e-9538-96d541a748b8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:53:40.098666 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:53:40.098411 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/255f033b-4be6-4f1e-9538-96d541a748b8-istiod-ca-cert\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:53:40.098666 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:53:40.098430 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/255f033b-4be6-4f1e-9538-96d541a748b8-workload-socket\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:53:40.098666 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:53:40.098444 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/255f033b-4be6-4f1e-9538-96d541a748b8-workload-certs\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:53:40.098666 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:53:40.098459 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/255f033b-4be6-4f1e-9538-96d541a748b8-credential-socket\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:53:40.098906 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:53:40.098876 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/255f033b-4be6-4f1e-9538-96d541a748b8-istio-data" (OuterVolumeSpecName: "istio-data") pod "255f033b-4be6-4f1e-9538-96d541a748b8" (UID: "255f033b-4be6-4f1e-9538-96d541a748b8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:53:40.100393 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:53:40.100363 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/255f033b-4be6-4f1e-9538-96d541a748b8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "255f033b-4be6-4f1e-9538-96d541a748b8" (UID: "255f033b-4be6-4f1e-9538-96d541a748b8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:53:40.100497 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:53:40.100468 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/255f033b-4be6-4f1e-9538-96d541a748b8-kube-api-access-4hsvp" (OuterVolumeSpecName: "kube-api-access-4hsvp") pod "255f033b-4be6-4f1e-9538-96d541a748b8" (UID: "255f033b-4be6-4f1e-9538-96d541a748b8"). InnerVolumeSpecName "kube-api-access-4hsvp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 14:53:40.100596 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:53:40.100577 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/255f033b-4be6-4f1e-9538-96d541a748b8-istio-token" (OuterVolumeSpecName: "istio-token") pod "255f033b-4be6-4f1e-9538-96d541a748b8" (UID: "255f033b-4be6-4f1e-9538-96d541a748b8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 14:53:40.100649 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:53:40.100600 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/255f033b-4be6-4f1e-9538-96d541a748b8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "255f033b-4be6-4f1e-9538-96d541a748b8" (UID: "255f033b-4be6-4f1e-9538-96d541a748b8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 21 14:53:40.199823 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:53:40.199756 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/255f033b-4be6-4f1e-9538-96d541a748b8-istio-data\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:53:40.199823 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:53:40.199818 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4hsvp\" (UniqueName: \"kubernetes.io/projected/255f033b-4be6-4f1e-9538-96d541a748b8-kube-api-access-4hsvp\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:53:40.199823 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:53:40.199834 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/255f033b-4be6-4f1e-9538-96d541a748b8-istio-token\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:53:40.200115 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:53:40.199845 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/255f033b-4be6-4f1e-9538-96d541a748b8-istio-envoy\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:53:40.200115 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:53:40.199853 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/255f033b-4be6-4f1e-9538-96d541a748b8-istio-podinfo\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:53:40.997126 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:53:40.997084 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx" event={"ID":"255f033b-4be6-4f1e-9538-96d541a748b8","Type":"ContainerDied","Data":"8a822c0f3607358d714124683e19aefa199f2e7d201fef36b5b7bceb0631a4a1"} Jul 21 14:53:40.997608 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:53:40.997158 2576 scope.go:117] "RemoveContainer" containerID="30b6ad61c520da22633f26a3c877c52ef0cad804281b9771bb17922dc7c89ece" Jul 21 14:53:40.997608 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:53:40.997095 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx" Jul 21 14:53:41.040523 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:53:41.040459 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx"] Jul 21 14:53:41.046190 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:53:41.046157 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-02afa090-openshift-default-79b7f64899-j2tbx"] Jul 21 14:53:41.527433 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:53:41.527394 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="255f033b-4be6-4f1e-9538-96d541a748b8" path="/var/lib/kubelet/pods/255f033b-4be6-4f1e-9538-96d541a748b8/volumes" Jul 21 14:54:32.423686 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:32.423649 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd"] Jul 21 14:54:32.424180 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:32.424046 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="255f033b-4be6-4f1e-9538-96d541a748b8" containerName="istio-proxy" Jul 21 14:54:32.424180 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:32.424058 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="255f033b-4be6-4f1e-9538-96d541a748b8" containerName="istio-proxy" Jul 21 14:54:32.424180 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:32.424078 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="255f033b-4be6-4f1e-9538-96d541a748b8" containerName="istio-proxy" Jul 21 14:54:32.424180 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:32.424083 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="255f033b-4be6-4f1e-9538-96d541a748b8" containerName="istio-proxy" Jul 21 14:54:32.424180 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:32.424149 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="255f033b-4be6-4f1e-9538-96d541a748b8" containerName="istio-proxy" Jul 21 14:54:32.424180 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:32.424158 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="255f033b-4be6-4f1e-9538-96d541a748b8" containerName="istio-proxy" Jul 21 14:54:32.427318 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:32.427299 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd" Jul 21 14:54:32.430629 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:32.430606 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-db7687-openshift-default-dockercfg-9t4ql\"" Jul 21 14:54:32.463801 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:32.463758 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd"] Jul 21 14:54:32.500016 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:32.499981 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa644240-2c69-450f-87d1-d618611b4f9c-istiod-ca-cert\") pod \"e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd\" (UID: \"aa644240-2c69-450f-87d1-d618611b4f9c\") " pod="openshift-ingress/e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd" Jul 21 14:54:32.500235 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:32.500042 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5vbm\" (UniqueName: \"kubernetes.io/projected/aa644240-2c69-450f-87d1-d618611b4f9c-kube-api-access-n5vbm\") pod \"e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd\" (UID: \"aa644240-2c69-450f-87d1-d618611b4f9c\") " pod="openshift-ingress/e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd" Jul 21 14:54:32.500235 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:32.500109 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa644240-2c69-450f-87d1-d618611b4f9c-workload-socket\") pod \"e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd\" (UID: \"aa644240-2c69-450f-87d1-d618611b4f9c\") " pod="openshift-ingress/e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd" Jul 21 14:54:32.500235 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:32.500157 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa644240-2c69-450f-87d1-d618611b4f9c-istio-envoy\") pod \"e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd\" (UID: \"aa644240-2c69-450f-87d1-d618611b4f9c\") " pod="openshift-ingress/e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd" Jul 21 14:54:32.500235 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:32.500206 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa644240-2c69-450f-87d1-d618611b4f9c-istio-data\") pod \"e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd\" (UID: \"aa644240-2c69-450f-87d1-d618611b4f9c\") " pod="openshift-ingress/e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd" Jul 21 14:54:32.500235 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:32.500233 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa644240-2c69-450f-87d1-d618611b4f9c-istio-podinfo\") pod \"e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd\" (UID: \"aa644240-2c69-450f-87d1-d618611b4f9c\") " pod="openshift-ingress/e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd" Jul 21 14:54:32.500484 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:32.500267 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa644240-2c69-450f-87d1-d618611b4f9c-workload-certs\") pod \"e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd\" (UID: \"aa644240-2c69-450f-87d1-d618611b4f9c\") " pod="openshift-ingress/e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd" Jul 21 14:54:32.500484 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:32.500307 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa644240-2c69-450f-87d1-d618611b4f9c-credential-socket\") pod \"e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd\" (UID: \"aa644240-2c69-450f-87d1-d618611b4f9c\") " pod="openshift-ingress/e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd" Jul 21 14:54:32.500484 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:32.500342 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa644240-2c69-450f-87d1-d618611b4f9c-istio-token\") pod \"e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd\" (UID: \"aa644240-2c69-450f-87d1-d618611b4f9c\") " pod="openshift-ingress/e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd" Jul 21 14:54:32.601621 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:32.601575 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa644240-2c69-450f-87d1-d618611b4f9c-workload-socket\") pod \"e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd\" (UID: \"aa644240-2c69-450f-87d1-d618611b4f9c\") " pod="openshift-ingress/e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd" Jul 21 14:54:32.601621 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:32.601622 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa644240-2c69-450f-87d1-d618611b4f9c-istio-envoy\") pod \"e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd\" (UID: \"aa644240-2c69-450f-87d1-d618611b4f9c\") " pod="openshift-ingress/e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd" Jul 21 14:54:32.601929 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:32.601762 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa644240-2c69-450f-87d1-d618611b4f9c-istio-data\") pod \"e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd\" (UID: \"aa644240-2c69-450f-87d1-d618611b4f9c\") " pod="openshift-ingress/e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd" Jul 21 14:54:32.601929 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:32.601825 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa644240-2c69-450f-87d1-d618611b4f9c-istio-podinfo\") pod \"e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd\" (UID: \"aa644240-2c69-450f-87d1-d618611b4f9c\") " pod="openshift-ingress/e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd" Jul 21 14:54:32.601929 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:32.601856 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa644240-2c69-450f-87d1-d618611b4f9c-workload-certs\") pod \"e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd\" (UID: \"aa644240-2c69-450f-87d1-d618611b4f9c\") " pod="openshift-ingress/e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd" Jul 21 14:54:32.601929 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:32.601907 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa644240-2c69-450f-87d1-d618611b4f9c-credential-socket\") pod \"e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd\" (UID: \"aa644240-2c69-450f-87d1-d618611b4f9c\") " pod="openshift-ingress/e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd" Jul 21 14:54:32.602145 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:32.602024 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa644240-2c69-450f-87d1-d618611b4f9c-istio-token\") pod \"e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd\" (UID: \"aa644240-2c69-450f-87d1-d618611b4f9c\") " pod="openshift-ingress/e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd" Jul 21 14:54:32.602145 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:32.602099 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa644240-2c69-450f-87d1-d618611b4f9c-istiod-ca-cert\") pod \"e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd\" (UID: \"aa644240-2c69-450f-87d1-d618611b4f9c\") " pod="openshift-ingress/e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd" Jul 21 14:54:32.602145 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:32.602121 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa644240-2c69-450f-87d1-d618611b4f9c-workload-socket\") pod \"e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd\" (UID: \"aa644240-2c69-450f-87d1-d618611b4f9c\") " pod="openshift-ingress/e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd" Jul 21 14:54:32.602301 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:32.602157 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5vbm\" (UniqueName: \"kubernetes.io/projected/aa644240-2c69-450f-87d1-d618611b4f9c-kube-api-access-n5vbm\") pod \"e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd\" (UID: \"aa644240-2c69-450f-87d1-d618611b4f9c\") " pod="openshift-ingress/e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd" Jul 21 14:54:32.602301 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:32.602210 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa644240-2c69-450f-87d1-d618611b4f9c-credential-socket\") pod \"e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd\" (UID: \"aa644240-2c69-450f-87d1-d618611b4f9c\") " pod="openshift-ingress/e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd" Jul 21 14:54:32.602301 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:32.602158 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa644240-2c69-450f-87d1-d618611b4f9c-istio-data\") pod \"e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd\" (UID: \"aa644240-2c69-450f-87d1-d618611b4f9c\") " pod="openshift-ingress/e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd" Jul 21 14:54:32.602301 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:32.602252 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa644240-2c69-450f-87d1-d618611b4f9c-workload-certs\") pod \"e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd\" (UID: \"aa644240-2c69-450f-87d1-d618611b4f9c\") " pod="openshift-ingress/e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd" Jul 21 14:54:32.602827 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:32.602773 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa644240-2c69-450f-87d1-d618611b4f9c-istiod-ca-cert\") pod \"e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd\" (UID: \"aa644240-2c69-450f-87d1-d618611b4f9c\") " pod="openshift-ingress/e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd" Jul 21 14:54:32.603947 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:32.603928 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa644240-2c69-450f-87d1-d618611b4f9c-istio-envoy\") pod \"e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd\" (UID: \"aa644240-2c69-450f-87d1-d618611b4f9c\") " pod="openshift-ingress/e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd" Jul 21 14:54:32.604315 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:32.604297 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa644240-2c69-450f-87d1-d618611b4f9c-istio-podinfo\") pod \"e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd\" (UID: \"aa644240-2c69-450f-87d1-d618611b4f9c\") " pod="openshift-ingress/e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd" Jul 21 14:54:32.611796 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:32.611753 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa644240-2c69-450f-87d1-d618611b4f9c-istio-token\") pod \"e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd\" (UID: \"aa644240-2c69-450f-87d1-d618611b4f9c\") " pod="openshift-ingress/e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd" Jul 21 14:54:32.612235 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:32.612212 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5vbm\" (UniqueName: \"kubernetes.io/projected/aa644240-2c69-450f-87d1-d618611b4f9c-kube-api-access-n5vbm\") pod \"e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd\" (UID: \"aa644240-2c69-450f-87d1-d618611b4f9c\") " pod="openshift-ingress/e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd" Jul 21 14:54:32.737201 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:32.737173 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd" Jul 21 14:54:32.891878 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:32.891839 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd"] Jul 21 14:54:32.892222 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:54:32.892193 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa644240_2c69_450f_87d1_d618611b4f9c.slice/crio-2a2c0c81eb8e3b2405c0534f3fc947287a982bc7c48966ca3fac6d76f5cb49a1 WatchSource:0}: Error finding container 2a2c0c81eb8e3b2405c0534f3fc947287a982bc7c48966ca3fac6d76f5cb49a1: Status 404 returned error can't find the container with id 2a2c0c81eb8e3b2405c0534f3fc947287a982bc7c48966ca3fac6d76f5cb49a1 Jul 21 14:54:32.894602 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:32.894572 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:54:32.894659 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:32.894639 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:54:32.894693 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:32.894668 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:54:33.287005 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:33.286963 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd" event={"ID":"aa644240-2c69-450f-87d1-d618611b4f9c","Type":"ContainerStarted","Data":"fed29eb7d629ec05cc59d7fd67649323ccb38696825e0ebc39b566a7aeeda935"} Jul 21 14:54:33.287226 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:33.287028 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd" event={"ID":"aa644240-2c69-450f-87d1-d618611b4f9c","Type":"ContainerStarted","Data":"2a2c0c81eb8e3b2405c0534f3fc947287a982bc7c48966ca3fac6d76f5cb49a1"} Jul 21 14:54:33.314590 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:33.314537 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd" podStartSLOduration=1.3145183839999999 podStartE2EDuration="1.314518384s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:54:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:54:33.311854908 +0000 UTC m=+2200.329758482" watchObservedRunningTime="2026-07-21 14:54:33.314518384 +0000 UTC m=+2200.332421958" Jul 21 14:54:33.737690 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:33.737656 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd" Jul 21 14:54:33.742926 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:33.742896 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd" Jul 21 14:54:34.292933 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:34.292904 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd" Jul 21 14:54:34.294114 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:34.294089 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd" Jul 21 14:54:40.329844 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:40.329807 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx"] Jul 21 14:54:40.334134 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:40.334113 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx" Jul 21 14:54:40.337511 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:40.337489 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-6c5a8f-openshift-default-dockercfg-7qc9b\"" Jul 21 14:54:40.349688 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:40.349658 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx"] Jul 21 14:54:40.481708 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:40.481670 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8671fbc8-8c2c-495e-941b-ddd2b5acad43-istiod-ca-cert\") pod \"e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx\" (UID: \"8671fbc8-8c2c-495e-941b-ddd2b5acad43\") " pod="openshift-ingress/e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx" Jul 21 14:54:40.481708 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:40.481713 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8671fbc8-8c2c-495e-941b-ddd2b5acad43-istio-token\") pod \"e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx\" (UID: \"8671fbc8-8c2c-495e-941b-ddd2b5acad43\") " pod="openshift-ingress/e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx" Jul 21 14:54:40.481942 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:40.481735 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8671fbc8-8c2c-495e-941b-ddd2b5acad43-credential-socket\") pod \"e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx\" (UID: \"8671fbc8-8c2c-495e-941b-ddd2b5acad43\") " pod="openshift-ingress/e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx" Jul 21 14:54:40.481942 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:40.481842 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bslsd\" (UniqueName: \"kubernetes.io/projected/8671fbc8-8c2c-495e-941b-ddd2b5acad43-kube-api-access-bslsd\") pod \"e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx\" (UID: \"8671fbc8-8c2c-495e-941b-ddd2b5acad43\") " pod="openshift-ingress/e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx" Jul 21 14:54:40.481942 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:40.481892 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8671fbc8-8c2c-495e-941b-ddd2b5acad43-istio-envoy\") pod \"e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx\" (UID: \"8671fbc8-8c2c-495e-941b-ddd2b5acad43\") " pod="openshift-ingress/e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx" Jul 21 14:54:40.481942 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:40.481926 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8671fbc8-8c2c-495e-941b-ddd2b5acad43-istio-data\") pod \"e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx\" (UID: \"8671fbc8-8c2c-495e-941b-ddd2b5acad43\") " pod="openshift-ingress/e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx" Jul 21 14:54:40.482077 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:40.481979 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8671fbc8-8c2c-495e-941b-ddd2b5acad43-workload-socket\") pod \"e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx\" (UID: \"8671fbc8-8c2c-495e-941b-ddd2b5acad43\") " pod="openshift-ingress/e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx" Jul 21 14:54:40.482077 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:40.482003 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8671fbc8-8c2c-495e-941b-ddd2b5acad43-workload-certs\") pod \"e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx\" (UID: \"8671fbc8-8c2c-495e-941b-ddd2b5acad43\") " pod="openshift-ingress/e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx" Jul 21 14:54:40.482144 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:40.482080 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8671fbc8-8c2c-495e-941b-ddd2b5acad43-istio-podinfo\") pod \"e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx\" (UID: \"8671fbc8-8c2c-495e-941b-ddd2b5acad43\") " pod="openshift-ingress/e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx" Jul 21 14:54:40.583276 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:40.583185 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8671fbc8-8c2c-495e-941b-ddd2b5acad43-workload-socket\") pod \"e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx\" (UID: \"8671fbc8-8c2c-495e-941b-ddd2b5acad43\") " pod="openshift-ingress/e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx" Jul 21 14:54:40.583276 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:40.583222 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8671fbc8-8c2c-495e-941b-ddd2b5acad43-workload-certs\") pod \"e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx\" (UID: \"8671fbc8-8c2c-495e-941b-ddd2b5acad43\") " pod="openshift-ingress/e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx" Jul 21 14:54:40.583276 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:40.583273 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8671fbc8-8c2c-495e-941b-ddd2b5acad43-istio-podinfo\") pod \"e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx\" (UID: \"8671fbc8-8c2c-495e-941b-ddd2b5acad43\") " pod="openshift-ingress/e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx" Jul 21 14:54:40.583565 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:40.583306 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8671fbc8-8c2c-495e-941b-ddd2b5acad43-istiod-ca-cert\") pod \"e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx\" (UID: \"8671fbc8-8c2c-495e-941b-ddd2b5acad43\") " pod="openshift-ingress/e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx" Jul 21 14:54:40.583565 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:40.583325 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8671fbc8-8c2c-495e-941b-ddd2b5acad43-istio-token\") pod \"e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx\" (UID: \"8671fbc8-8c2c-495e-941b-ddd2b5acad43\") " pod="openshift-ingress/e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx" Jul 21 14:54:40.583565 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:40.583342 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8671fbc8-8c2c-495e-941b-ddd2b5acad43-credential-socket\") pod \"e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx\" (UID: \"8671fbc8-8c2c-495e-941b-ddd2b5acad43\") " pod="openshift-ingress/e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx" Jul 21 14:54:40.583565 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:40.583378 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bslsd\" (UniqueName: \"kubernetes.io/projected/8671fbc8-8c2c-495e-941b-ddd2b5acad43-kube-api-access-bslsd\") pod \"e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx\" (UID: \"8671fbc8-8c2c-495e-941b-ddd2b5acad43\") " pod="openshift-ingress/e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx" Jul 21 14:54:40.583565 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:40.583416 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8671fbc8-8c2c-495e-941b-ddd2b5acad43-istio-envoy\") pod \"e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx\" (UID: \"8671fbc8-8c2c-495e-941b-ddd2b5acad43\") " pod="openshift-ingress/e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx" Jul 21 14:54:40.583565 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:40.583457 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8671fbc8-8c2c-495e-941b-ddd2b5acad43-istio-data\") pod \"e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx\" (UID: \"8671fbc8-8c2c-495e-941b-ddd2b5acad43\") " pod="openshift-ingress/e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx" Jul 21 14:54:40.583938 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:40.583678 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8671fbc8-8c2c-495e-941b-ddd2b5acad43-workload-socket\") pod \"e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx\" (UID: \"8671fbc8-8c2c-495e-941b-ddd2b5acad43\") " pod="openshift-ingress/e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx" Jul 21 14:54:40.583938 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:40.583842 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8671fbc8-8c2c-495e-941b-ddd2b5acad43-workload-certs\") pod \"e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx\" (UID: \"8671fbc8-8c2c-495e-941b-ddd2b5acad43\") " pod="openshift-ingress/e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx" Jul 21 14:54:40.583938 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:40.583843 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8671fbc8-8c2c-495e-941b-ddd2b5acad43-credential-socket\") pod \"e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx\" (UID: \"8671fbc8-8c2c-495e-941b-ddd2b5acad43\") " pod="openshift-ingress/e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx" Jul 21 14:54:40.583938 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:40.583919 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8671fbc8-8c2c-495e-941b-ddd2b5acad43-istio-data\") pod \"e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx\" (UID: \"8671fbc8-8c2c-495e-941b-ddd2b5acad43\") " pod="openshift-ingress/e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx" Jul 21 14:54:40.584328 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:40.584305 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8671fbc8-8c2c-495e-941b-ddd2b5acad43-istiod-ca-cert\") pod \"e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx\" (UID: \"8671fbc8-8c2c-495e-941b-ddd2b5acad43\") " pod="openshift-ingress/e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx" Jul 21 14:54:40.585790 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:40.585756 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8671fbc8-8c2c-495e-941b-ddd2b5acad43-istio-envoy\") pod \"e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx\" (UID: \"8671fbc8-8c2c-495e-941b-ddd2b5acad43\") " pod="openshift-ingress/e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx" Jul 21 14:54:40.586029 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:40.586007 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8671fbc8-8c2c-495e-941b-ddd2b5acad43-istio-podinfo\") pod \"e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx\" (UID: \"8671fbc8-8c2c-495e-941b-ddd2b5acad43\") " pod="openshift-ingress/e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx" Jul 21 14:54:40.593718 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:40.593689 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8671fbc8-8c2c-495e-941b-ddd2b5acad43-istio-token\") pod \"e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx\" (UID: \"8671fbc8-8c2c-495e-941b-ddd2b5acad43\") " pod="openshift-ingress/e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx" Jul 21 14:54:40.593903 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:40.593876 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bslsd\" (UniqueName: \"kubernetes.io/projected/8671fbc8-8c2c-495e-941b-ddd2b5acad43-kube-api-access-bslsd\") pod \"e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx\" (UID: \"8671fbc8-8c2c-495e-941b-ddd2b5acad43\") " pod="openshift-ingress/e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx" Jul 21 14:54:40.645133 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:40.644907 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx" Jul 21 14:54:40.797209 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:40.797183 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx"] Jul 21 14:54:40.798346 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:54:40.798324 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8671fbc8_8c2c_495e_941b_ddd2b5acad43.slice/crio-a538ad6503b25b0553606dac113dec6193fa1afee7447b46151a532c4b97ddb3 WatchSource:0}: Error finding container a538ad6503b25b0553606dac113dec6193fa1afee7447b46151a532c4b97ddb3: Status 404 returned error can't find the container with id a538ad6503b25b0553606dac113dec6193fa1afee7447b46151a532c4b97ddb3 Jul 21 14:54:40.800554 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:40.800518 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:54:40.800644 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:40.800589 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:54:40.800644 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:40.800629 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:54:41.337577 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:41.337530 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx" event={"ID":"8671fbc8-8c2c-495e-941b-ddd2b5acad43","Type":"ContainerStarted","Data":"d6c8d80283cc0cc9e0d19caddd9acc5b8258001995cf44e735abc4aaf0929a86"} Jul 21 14:54:41.338097 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:41.337602 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx" event={"ID":"8671fbc8-8c2c-495e-941b-ddd2b5acad43","Type":"ContainerStarted","Data":"a538ad6503b25b0553606dac113dec6193fa1afee7447b46151a532c4b97ddb3"} Jul 21 14:54:41.376528 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:41.376473 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx" podStartSLOduration=1.376456618 podStartE2EDuration="1.376456618s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:54:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:54:41.375314783 +0000 UTC m=+2208.393218361" watchObservedRunningTime="2026-07-21 14:54:41.376456618 +0000 UTC m=+2208.394360273" Jul 21 14:54:41.646111 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:41.646008 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx" Jul 21 14:54:41.647661 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:41.647633 2576 patch_prober.go:28] interesting pod/e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body= Jul 21 14:54:41.647805 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:41.647681 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx" podUID="8671fbc8-8c2c-495e-941b-ddd2b5acad43" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" Jul 21 14:54:42.649303 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:42.649268 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx" Jul 21 14:54:43.349190 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:43.349149 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx" Jul 21 14:54:43.350121 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:43.350099 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx" Jul 21 14:54:48.386364 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:48.386271 2576 generic.go:356] "Generic (PLEG): container finished" podID="aa644240-2c69-450f-87d1-d618611b4f9c" containerID="fed29eb7d629ec05cc59d7fd67649323ccb38696825e0ebc39b566a7aeeda935" exitCode=0 Jul 21 14:54:48.386364 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:48.386323 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd" event={"ID":"aa644240-2c69-450f-87d1-d618611b4f9c","Type":"ContainerDied","Data":"fed29eb7d629ec05cc59d7fd67649323ccb38696825e0ebc39b566a7aeeda935"} Jul 21 14:54:48.386825 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:48.386758 2576 scope.go:117] "RemoveContainer" containerID="fed29eb7d629ec05cc59d7fd67649323ccb38696825e0ebc39b566a7aeeda935" Jul 21 14:54:48.387882 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:48.387854 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:54:48.387951 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:48.387934 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:54:48.388031 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:48.388015 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:54:49.293582 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:49.293538 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd" Jul 21 14:54:49.394575 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:49.394535 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd" event={"ID":"aa644240-2c69-450f-87d1-d618611b4f9c","Type":"ContainerStarted","Data":"d971561ebc473438e3afac2f672168f508fc58f369e0042ba285c707d4b534b8"} Jul 21 14:54:49.738080 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:49.738045 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd" Jul 21 14:54:49.739252 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:49.739225 2576 patch_prober.go:28] interesting pod/e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body= Jul 21 14:54:49.739376 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:49.739291 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd" podUID="aa644240-2c69-450f-87d1-d618611b4f9c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" Jul 21 14:54:50.738116 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:50.738079 2576 patch_prober.go:28] interesting pod/e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body= Jul 21 14:54:50.738555 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:50.738142 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd" podUID="aa644240-2c69-450f-87d1-d618611b4f9c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" Jul 21 14:54:51.738150 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:51.738115 2576 patch_prober.go:28] interesting pod/e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body= Jul 21 14:54:51.738563 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:51.738173 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd" podUID="aa644240-2c69-450f-87d1-d618611b4f9c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" Jul 21 14:54:52.738032 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:52.737982 2576 patch_prober.go:28] interesting pod/e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body= Jul 21 14:54:52.738261 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:52.738060 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd" podUID="aa644240-2c69-450f-87d1-d618611b4f9c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" Jul 21 14:54:53.742324 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:53.742290 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd" Jul 21 14:54:53.742828 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:53.742565 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd" Jul 21 14:54:53.743378 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:53.743362 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd" Jul 21 14:54:59.389994 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:59.389953 2576 patch_prober.go:28] interesting pod/e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 21 14:54:59.390459 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:54:59.390023 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx" podUID="8671fbc8-8c2c-495e-941b-ddd2b5acad43" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 21 14:55:00.473862 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:55:00.473814 2576 generic.go:356] "Generic (PLEG): container finished" podID="8671fbc8-8c2c-495e-941b-ddd2b5acad43" containerID="d6c8d80283cc0cc9e0d19caddd9acc5b8258001995cf44e735abc4aaf0929a86" exitCode=0 Jul 21 14:55:00.474367 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:55:00.473883 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx" event={"ID":"8671fbc8-8c2c-495e-941b-ddd2b5acad43","Type":"ContainerDied","Data":"d6c8d80283cc0cc9e0d19caddd9acc5b8258001995cf44e735abc4aaf0929a86"} Jul 21 14:55:00.474367 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:55:00.474345 2576 scope.go:117] "RemoveContainer" containerID="d6c8d80283cc0cc9e0d19caddd9acc5b8258001995cf44e735abc4aaf0929a86" Jul 21 14:55:00.475401 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:55:00.475369 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:55:00.475508 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:55:00.475438 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:55:00.475508 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:55:00.475468 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:55:01.481646 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:55:01.481614 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx" event={"ID":"8671fbc8-8c2c-495e-941b-ddd2b5acad43","Type":"ContainerStarted","Data":"00141f1246dff7aa363aba68f680a05a404e786b9df10e852fb2d618337dfa94"} Jul 21 14:55:01.645157 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:55:01.645117 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx" Jul 21 14:55:01.645412 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:55:01.645386 2576 patch_prober.go:28] interesting pod/e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body= Jul 21 14:55:01.645468 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:55:01.645444 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx" podUID="8671fbc8-8c2c-495e-941b-ddd2b5acad43" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" Jul 21 14:55:02.645886 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:55:02.645850 2576 patch_prober.go:28] interesting pod/e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body= Jul 21 14:55:02.646317 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:55:02.645917 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx" podUID="8671fbc8-8c2c-495e-941b-ddd2b5acad43" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" Jul 21 14:55:03.645542 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:55:03.645503 2576 patch_prober.go:28] interesting pod/e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body= Jul 21 14:55:03.645899 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:55:03.645584 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx" podUID="8671fbc8-8c2c-495e-941b-ddd2b5acad43" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" Jul 21 14:55:04.645409 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:55:04.645363 2576 patch_prober.go:28] interesting pod/e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body= Jul 21 14:55:04.645631 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:55:04.645427 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx" podUID="8671fbc8-8c2c-495e-941b-ddd2b5acad43" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" Jul 21 14:55:05.685060 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:55:05.685031 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx" Jul 21 14:55:05.685464 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:55:05.685295 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx" Jul 21 14:55:05.686192 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:55:05.686172 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx" Jul 21 14:56:56.886741 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:56:56.886700 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd"] Jul 21 14:56:56.887389 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:56:56.886962 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd" podUID="aa644240-2c69-450f-87d1-d618611b4f9c" containerName="istio-proxy" containerID="cri-o://d971561ebc473438e3afac2f672168f508fc58f369e0042ba285c707d4b534b8" gracePeriod=30 Jul 21 14:57:02.148426 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:02.148350 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd" Jul 21 14:57:02.156303 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:02.156275 2576 generic.go:356] "Generic (PLEG): container finished" podID="aa644240-2c69-450f-87d1-d618611b4f9c" containerID="d971561ebc473438e3afac2f672168f508fc58f369e0042ba285c707d4b534b8" exitCode=0 Jul 21 14:57:02.156461 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:02.156321 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd" Jul 21 14:57:02.156461 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:02.156347 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd" event={"ID":"aa644240-2c69-450f-87d1-d618611b4f9c","Type":"ContainerDied","Data":"d971561ebc473438e3afac2f672168f508fc58f369e0042ba285c707d4b534b8"} Jul 21 14:57:02.156461 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:02.156437 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd" event={"ID":"aa644240-2c69-450f-87d1-d618611b4f9c","Type":"ContainerDied","Data":"2a2c0c81eb8e3b2405c0534f3fc947287a982bc7c48966ca3fac6d76f5cb49a1"} Jul 21 14:57:02.156461 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:02.156462 2576 scope.go:117] "RemoveContainer" containerID="d971561ebc473438e3afac2f672168f508fc58f369e0042ba285c707d4b534b8" Jul 21 14:57:02.165985 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:02.165967 2576 scope.go:117] "RemoveContainer" containerID="fed29eb7d629ec05cc59d7fd67649323ccb38696825e0ebc39b566a7aeeda935" Jul 21 14:57:02.176149 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:02.176127 2576 scope.go:117] "RemoveContainer" containerID="d971561ebc473438e3afac2f672168f508fc58f369e0042ba285c707d4b534b8" Jul 21 14:57:02.176595 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:57:02.176564 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d971561ebc473438e3afac2f672168f508fc58f369e0042ba285c707d4b534b8\": container with ID starting with d971561ebc473438e3afac2f672168f508fc58f369e0042ba285c707d4b534b8 not found: ID does not exist" containerID="d971561ebc473438e3afac2f672168f508fc58f369e0042ba285c707d4b534b8" Jul 21 14:57:02.176811 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:02.176758 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d971561ebc473438e3afac2f672168f508fc58f369e0042ba285c707d4b534b8"} err="failed to get container status \"d971561ebc473438e3afac2f672168f508fc58f369e0042ba285c707d4b534b8\": rpc error: code = NotFound desc = could not find container \"d971561ebc473438e3afac2f672168f508fc58f369e0042ba285c707d4b534b8\": container with ID starting with d971561ebc473438e3afac2f672168f508fc58f369e0042ba285c707d4b534b8 not found: ID does not exist" Jul 21 14:57:02.176960 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:02.176922 2576 scope.go:117] "RemoveContainer" containerID="fed29eb7d629ec05cc59d7fd67649323ccb38696825e0ebc39b566a7aeeda935" Jul 21 14:57:02.177346 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:57:02.177318 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fed29eb7d629ec05cc59d7fd67649323ccb38696825e0ebc39b566a7aeeda935\": container with ID starting with fed29eb7d629ec05cc59d7fd67649323ccb38696825e0ebc39b566a7aeeda935 not found: ID does not exist" containerID="fed29eb7d629ec05cc59d7fd67649323ccb38696825e0ebc39b566a7aeeda935" Jul 21 14:57:02.177450 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:02.177354 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fed29eb7d629ec05cc59d7fd67649323ccb38696825e0ebc39b566a7aeeda935"} err="failed to get container status \"fed29eb7d629ec05cc59d7fd67649323ccb38696825e0ebc39b566a7aeeda935\": rpc error: code = NotFound desc = could not find container \"fed29eb7d629ec05cc59d7fd67649323ccb38696825e0ebc39b566a7aeeda935\": container with ID starting with fed29eb7d629ec05cc59d7fd67649323ccb38696825e0ebc39b566a7aeeda935 not found: ID does not exist" Jul 21 14:57:02.302217 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:02.302177 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa644240-2c69-450f-87d1-d618611b4f9c-istio-token\") pod \"aa644240-2c69-450f-87d1-d618611b4f9c\" (UID: \"aa644240-2c69-450f-87d1-d618611b4f9c\") " Jul 21 14:57:02.302425 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:02.302232 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa644240-2c69-450f-87d1-d618611b4f9c-workload-certs\") pod \"aa644240-2c69-450f-87d1-d618611b4f9c\" (UID: \"aa644240-2c69-450f-87d1-d618611b4f9c\") " Jul 21 14:57:02.302425 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:02.302252 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa644240-2c69-450f-87d1-d618611b4f9c-credential-socket\") pod \"aa644240-2c69-450f-87d1-d618611b4f9c\" (UID: \"aa644240-2c69-450f-87d1-d618611b4f9c\") " Jul 21 14:57:02.302425 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:02.302272 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa644240-2c69-450f-87d1-d618611b4f9c-workload-socket\") pod \"aa644240-2c69-450f-87d1-d618611b4f9c\" (UID: \"aa644240-2c69-450f-87d1-d618611b4f9c\") " Jul 21 14:57:02.302425 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:02.302298 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n5vbm\" (UniqueName: \"kubernetes.io/projected/aa644240-2c69-450f-87d1-d618611b4f9c-kube-api-access-n5vbm\") pod \"aa644240-2c69-450f-87d1-d618611b4f9c\" (UID: \"aa644240-2c69-450f-87d1-d618611b4f9c\") " Jul 21 14:57:02.302425 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:02.302324 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa644240-2c69-450f-87d1-d618611b4f9c-istio-podinfo\") pod \"aa644240-2c69-450f-87d1-d618611b4f9c\" (UID: \"aa644240-2c69-450f-87d1-d618611b4f9c\") " Jul 21 14:57:02.302425 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:02.302419 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa644240-2c69-450f-87d1-d618611b4f9c-istio-envoy\") pod \"aa644240-2c69-450f-87d1-d618611b4f9c\" (UID: \"aa644240-2c69-450f-87d1-d618611b4f9c\") " Jul 21 14:57:02.302741 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:02.302466 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa644240-2c69-450f-87d1-d618611b4f9c-istio-data\") pod \"aa644240-2c69-450f-87d1-d618611b4f9c\" (UID: \"aa644240-2c69-450f-87d1-d618611b4f9c\") " Jul 21 14:57:02.302741 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:02.302502 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa644240-2c69-450f-87d1-d618611b4f9c-istiod-ca-cert\") pod \"aa644240-2c69-450f-87d1-d618611b4f9c\" (UID: \"aa644240-2c69-450f-87d1-d618611b4f9c\") " Jul 21 14:57:02.302741 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:02.302605 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa644240-2c69-450f-87d1-d618611b4f9c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "aa644240-2c69-450f-87d1-d618611b4f9c" (UID: "aa644240-2c69-450f-87d1-d618611b4f9c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:57:02.302741 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:02.302620 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa644240-2c69-450f-87d1-d618611b4f9c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "aa644240-2c69-450f-87d1-d618611b4f9c" (UID: "aa644240-2c69-450f-87d1-d618611b4f9c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:57:02.302741 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:02.302633 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa644240-2c69-450f-87d1-d618611b4f9c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "aa644240-2c69-450f-87d1-d618611b4f9c" (UID: "aa644240-2c69-450f-87d1-d618611b4f9c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:57:02.303035 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:02.302943 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa644240-2c69-450f-87d1-d618611b4f9c-workload-certs\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:57:02.303035 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:02.302967 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa644240-2c69-450f-87d1-d618611b4f9c-credential-socket\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:57:02.303035 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:02.302983 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa644240-2c69-450f-87d1-d618611b4f9c-workload-socket\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:57:02.303035 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:02.302983 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa644240-2c69-450f-87d1-d618611b4f9c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "aa644240-2c69-450f-87d1-d618611b4f9c" (UID: "aa644240-2c69-450f-87d1-d618611b4f9c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 14:57:02.303439 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:02.303415 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa644240-2c69-450f-87d1-d618611b4f9c-istio-data" (OuterVolumeSpecName: "istio-data") pod "aa644240-2c69-450f-87d1-d618611b4f9c" (UID: "aa644240-2c69-450f-87d1-d618611b4f9c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:57:02.304814 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:02.304769 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa644240-2c69-450f-87d1-d618611b4f9c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "aa644240-2c69-450f-87d1-d618611b4f9c" (UID: "aa644240-2c69-450f-87d1-d618611b4f9c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:57:02.304814 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:02.304804 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa644240-2c69-450f-87d1-d618611b4f9c-istio-token" (OuterVolumeSpecName: "istio-token") pod "aa644240-2c69-450f-87d1-d618611b4f9c" (UID: "aa644240-2c69-450f-87d1-d618611b4f9c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 14:57:02.305111 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:02.305090 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa644240-2c69-450f-87d1-d618611b4f9c-kube-api-access-n5vbm" (OuterVolumeSpecName: "kube-api-access-n5vbm") pod "aa644240-2c69-450f-87d1-d618611b4f9c" (UID: "aa644240-2c69-450f-87d1-d618611b4f9c"). InnerVolumeSpecName "kube-api-access-n5vbm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 14:57:02.305164 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:02.305089 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/aa644240-2c69-450f-87d1-d618611b4f9c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "aa644240-2c69-450f-87d1-d618611b4f9c" (UID: "aa644240-2c69-450f-87d1-d618611b4f9c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 21 14:57:02.404316 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:02.404224 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa644240-2c69-450f-87d1-d618611b4f9c-istio-envoy\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:57:02.404316 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:02.404258 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa644240-2c69-450f-87d1-d618611b4f9c-istio-data\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:57:02.404316 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:02.404267 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa644240-2c69-450f-87d1-d618611b4f9c-istiod-ca-cert\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:57:02.404316 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:02.404275 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa644240-2c69-450f-87d1-d618611b4f9c-istio-token\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:57:02.404316 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:02.404283 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n5vbm\" (UniqueName: \"kubernetes.io/projected/aa644240-2c69-450f-87d1-d618611b4f9c-kube-api-access-n5vbm\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:57:02.404316 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:02.404292 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa644240-2c69-450f-87d1-d618611b4f9c-istio-podinfo\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:57:02.486056 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:02.486018 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd"] Jul 21 14:57:02.488843 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:02.488800 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-db7687-openshift-default-6b865f87df-ffcvd"] Jul 21 14:57:03.526699 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:03.526662 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa644240-2c69-450f-87d1-d618611b4f9c" path="/var/lib/kubelet/pods/aa644240-2c69-450f-87d1-d618611b4f9c/volumes" Jul 21 14:57:19.489306 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:19.489262 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx"] Jul 21 14:57:19.489809 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:19.489522 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx" podUID="8671fbc8-8c2c-495e-941b-ddd2b5acad43" containerName="istio-proxy" containerID="cri-o://00141f1246dff7aa363aba68f680a05a404e786b9df10e852fb2d618337dfa94" gracePeriod=30 Jul 21 14:57:20.390917 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:20.390879 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf"] Jul 21 14:57:20.391408 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:20.391382 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa644240-2c69-450f-87d1-d618611b4f9c" containerName="istio-proxy" Jul 21 14:57:20.391408 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:20.391405 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa644240-2c69-450f-87d1-d618611b4f9c" containerName="istio-proxy" Jul 21 14:57:20.391583 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:20.391421 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa644240-2c69-450f-87d1-d618611b4f9c" containerName="istio-proxy" Jul 21 14:57:20.391583 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:20.391429 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa644240-2c69-450f-87d1-d618611b4f9c" containerName="istio-proxy" Jul 21 14:57:20.391583 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:20.391497 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa644240-2c69-450f-87d1-d618611b4f9c" containerName="istio-proxy" Jul 21 14:57:20.391583 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:20.391506 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa644240-2c69-450f-87d1-d618611b4f9c" containerName="istio-proxy" Jul 21 14:57:20.394648 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:20.394631 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf" Jul 21 14:57:20.397298 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:20.397273 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-6ecdf5-openshift-default-dockercfg-lqfl4\"" Jul 21 14:57:20.408496 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:20.408458 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf"] Jul 21 14:57:20.478770 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:20.478728 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0daad0f6-785c-4149-bfba-7543db2d2e4f-istio-token\") pod \"e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf\" (UID: \"0daad0f6-785c-4149-bfba-7543db2d2e4f\") " pod="openshift-ingress/e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf" Jul 21 14:57:20.478992 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:20.478808 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0daad0f6-785c-4149-bfba-7543db2d2e4f-istio-data\") pod \"e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf\" (UID: \"0daad0f6-785c-4149-bfba-7543db2d2e4f\") " pod="openshift-ingress/e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf" Jul 21 14:57:20.478992 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:20.478877 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0daad0f6-785c-4149-bfba-7543db2d2e4f-workload-socket\") pod \"e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf\" (UID: \"0daad0f6-785c-4149-bfba-7543db2d2e4f\") " pod="openshift-ingress/e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf" Jul 21 14:57:20.478992 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:20.478904 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0daad0f6-785c-4149-bfba-7543db2d2e4f-workload-certs\") pod \"e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf\" (UID: \"0daad0f6-785c-4149-bfba-7543db2d2e4f\") " pod="openshift-ingress/e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf" Jul 21 14:57:20.478992 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:20.478931 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0daad0f6-785c-4149-bfba-7543db2d2e4f-credential-socket\") pod \"e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf\" (UID: \"0daad0f6-785c-4149-bfba-7543db2d2e4f\") " pod="openshift-ingress/e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf" Jul 21 14:57:20.479230 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:20.479046 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpxz7\" (UniqueName: \"kubernetes.io/projected/0daad0f6-785c-4149-bfba-7543db2d2e4f-kube-api-access-hpxz7\") pod \"e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf\" (UID: \"0daad0f6-785c-4149-bfba-7543db2d2e4f\") " pod="openshift-ingress/e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf" Jul 21 14:57:20.479230 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:20.479083 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0daad0f6-785c-4149-bfba-7543db2d2e4f-istio-podinfo\") pod \"e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf\" (UID: \"0daad0f6-785c-4149-bfba-7543db2d2e4f\") " pod="openshift-ingress/e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf" Jul 21 14:57:20.479230 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:20.479113 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0daad0f6-785c-4149-bfba-7543db2d2e4f-istio-envoy\") pod \"e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf\" (UID: \"0daad0f6-785c-4149-bfba-7543db2d2e4f\") " pod="openshift-ingress/e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf" Jul 21 14:57:20.479230 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:20.479224 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0daad0f6-785c-4149-bfba-7543db2d2e4f-istiod-ca-cert\") pod \"e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf\" (UID: \"0daad0f6-785c-4149-bfba-7543db2d2e4f\") " pod="openshift-ingress/e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf" Jul 21 14:57:20.580069 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:20.580035 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0daad0f6-785c-4149-bfba-7543db2d2e4f-workload-certs\") pod \"e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf\" (UID: \"0daad0f6-785c-4149-bfba-7543db2d2e4f\") " pod="openshift-ingress/e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf" Jul 21 14:57:20.580069 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:20.580072 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0daad0f6-785c-4149-bfba-7543db2d2e4f-credential-socket\") pod \"e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf\" (UID: \"0daad0f6-785c-4149-bfba-7543db2d2e4f\") " pod="openshift-ingress/e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf" Jul 21 14:57:20.580567 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:20.580118 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpxz7\" (UniqueName: \"kubernetes.io/projected/0daad0f6-785c-4149-bfba-7543db2d2e4f-kube-api-access-hpxz7\") pod \"e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf\" (UID: \"0daad0f6-785c-4149-bfba-7543db2d2e4f\") " pod="openshift-ingress/e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf" Jul 21 14:57:20.580567 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:20.580141 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0daad0f6-785c-4149-bfba-7543db2d2e4f-istio-podinfo\") pod \"e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf\" (UID: \"0daad0f6-785c-4149-bfba-7543db2d2e4f\") " pod="openshift-ingress/e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf" Jul 21 14:57:20.580567 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:20.580166 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0daad0f6-785c-4149-bfba-7543db2d2e4f-istio-envoy\") pod \"e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf\" (UID: \"0daad0f6-785c-4149-bfba-7543db2d2e4f\") " pod="openshift-ingress/e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf" Jul 21 14:57:20.580567 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:20.580219 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0daad0f6-785c-4149-bfba-7543db2d2e4f-istiod-ca-cert\") pod \"e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf\" (UID: \"0daad0f6-785c-4149-bfba-7543db2d2e4f\") " pod="openshift-ingress/e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf" Jul 21 14:57:20.580567 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:20.580290 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0daad0f6-785c-4149-bfba-7543db2d2e4f-istio-token\") pod \"e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf\" (UID: \"0daad0f6-785c-4149-bfba-7543db2d2e4f\") " pod="openshift-ingress/e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf" Jul 21 14:57:20.580567 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:20.580341 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0daad0f6-785c-4149-bfba-7543db2d2e4f-istio-data\") pod \"e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf\" (UID: \"0daad0f6-785c-4149-bfba-7543db2d2e4f\") " pod="openshift-ingress/e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf" Jul 21 14:57:20.580567 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:20.580435 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0daad0f6-785c-4149-bfba-7543db2d2e4f-workload-socket\") pod \"e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf\" (UID: \"0daad0f6-785c-4149-bfba-7543db2d2e4f\") " pod="openshift-ingress/e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf" Jul 21 14:57:20.580567 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:20.580509 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0daad0f6-785c-4149-bfba-7543db2d2e4f-workload-certs\") pod \"e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf\" (UID: \"0daad0f6-785c-4149-bfba-7543db2d2e4f\") " pod="openshift-ingress/e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf" Jul 21 14:57:20.581001 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:20.580585 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0daad0f6-785c-4149-bfba-7543db2d2e4f-credential-socket\") pod \"e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf\" (UID: \"0daad0f6-785c-4149-bfba-7543db2d2e4f\") " pod="openshift-ingress/e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf" Jul 21 14:57:20.581001 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:20.580870 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0daad0f6-785c-4149-bfba-7543db2d2e4f-istio-data\") pod \"e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf\" (UID: \"0daad0f6-785c-4149-bfba-7543db2d2e4f\") " pod="openshift-ingress/e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf" Jul 21 14:57:20.581084 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:20.580999 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0daad0f6-785c-4149-bfba-7543db2d2e4f-workload-socket\") pod \"e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf\" (UID: \"0daad0f6-785c-4149-bfba-7543db2d2e4f\") " pod="openshift-ingress/e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf" Jul 21 14:57:20.581279 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:20.581262 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0daad0f6-785c-4149-bfba-7543db2d2e4f-istiod-ca-cert\") pod \"e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf\" (UID: \"0daad0f6-785c-4149-bfba-7543db2d2e4f\") " pod="openshift-ingress/e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf" Jul 21 14:57:20.582648 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:20.582625 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0daad0f6-785c-4149-bfba-7543db2d2e4f-istio-envoy\") pod \"e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf\" (UID: \"0daad0f6-785c-4149-bfba-7543db2d2e4f\") " pod="openshift-ingress/e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf" Jul 21 14:57:20.582881 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:20.582862 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0daad0f6-785c-4149-bfba-7543db2d2e4f-istio-podinfo\") pod \"e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf\" (UID: \"0daad0f6-785c-4149-bfba-7543db2d2e4f\") " pod="openshift-ingress/e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf" Jul 21 14:57:20.589749 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:20.589718 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0daad0f6-785c-4149-bfba-7543db2d2e4f-istio-token\") pod \"e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf\" (UID: \"0daad0f6-785c-4149-bfba-7543db2d2e4f\") " pod="openshift-ingress/e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf" Jul 21 14:57:20.589967 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:20.589848 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpxz7\" (UniqueName: \"kubernetes.io/projected/0daad0f6-785c-4149-bfba-7543db2d2e4f-kube-api-access-hpxz7\") pod \"e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf\" (UID: \"0daad0f6-785c-4149-bfba-7543db2d2e4f\") " pod="openshift-ingress/e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf" Jul 21 14:57:20.688112 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:20.688018 2576 patch_prober.go:28] interesting pod/e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 21 14:57:20.688112 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:20.688087 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx" podUID="8671fbc8-8c2c-495e-941b-ddd2b5acad43" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 21 14:57:20.705441 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:20.705405 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf" Jul 21 14:57:20.857804 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:20.857759 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf"] Jul 21 14:57:20.859079 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:57:20.859050 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0daad0f6_785c_4149_bfba_7543db2d2e4f.slice/crio-481c84ccdc5e1faa5384d0b2c6a4f2f2a58efadf0ffa3cd2d80f31298589ca64 WatchSource:0}: Error finding container 481c84ccdc5e1faa5384d0b2c6a4f2f2a58efadf0ffa3cd2d80f31298589ca64: Status 404 returned error can't find the container with id 481c84ccdc5e1faa5384d0b2c6a4f2f2a58efadf0ffa3cd2d80f31298589ca64 Jul 21 14:57:20.861613 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:20.861575 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:57:20.861730 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:20.861662 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:57:20.861730 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:20.861710 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:57:21.265684 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:21.265632 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf" event={"ID":"0daad0f6-785c-4149-bfba-7543db2d2e4f","Type":"ContainerStarted","Data":"0001af7a19e90c46ab17d88a744a620b00a175d9246be5e0ed6f10abd4ff9ecf"} Jul 21 14:57:21.265872 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:21.265741 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf" event={"ID":"0daad0f6-785c-4149-bfba-7543db2d2e4f","Type":"ContainerStarted","Data":"481c84ccdc5e1faa5384d0b2c6a4f2f2a58efadf0ffa3cd2d80f31298589ca64"} Jul 21 14:57:21.288434 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:21.288378 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf" podStartSLOduration=1.288357942 podStartE2EDuration="1.288357942s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:57:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:57:21.285953755 +0000 UTC m=+2368.303857330" watchObservedRunningTime="2026-07-21 14:57:21.288357942 +0000 UTC m=+2368.306261515" Jul 21 14:57:21.706401 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:21.706309 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf" Jul 21 14:57:21.711449 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:21.711424 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf" Jul 21 14:57:22.272063 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:22.272029 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf" Jul 21 14:57:22.273242 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:22.273219 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf" Jul 21 14:57:24.756152 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:24.756078 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx" Jul 21 14:57:24.822767 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:24.822726 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8671fbc8-8c2c-495e-941b-ddd2b5acad43-istiod-ca-cert\") pod \"8671fbc8-8c2c-495e-941b-ddd2b5acad43\" (UID: \"8671fbc8-8c2c-495e-941b-ddd2b5acad43\") " Jul 21 14:57:24.822995 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:24.822803 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8671fbc8-8c2c-495e-941b-ddd2b5acad43-istio-envoy\") pod \"8671fbc8-8c2c-495e-941b-ddd2b5acad43\" (UID: \"8671fbc8-8c2c-495e-941b-ddd2b5acad43\") " Jul 21 14:57:24.822995 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:24.822840 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8671fbc8-8c2c-495e-941b-ddd2b5acad43-credential-socket\") pod \"8671fbc8-8c2c-495e-941b-ddd2b5acad43\" (UID: \"8671fbc8-8c2c-495e-941b-ddd2b5acad43\") " Jul 21 14:57:24.822995 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:24.822869 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bslsd\" (UniqueName: \"kubernetes.io/projected/8671fbc8-8c2c-495e-941b-ddd2b5acad43-kube-api-access-bslsd\") pod \"8671fbc8-8c2c-495e-941b-ddd2b5acad43\" (UID: \"8671fbc8-8c2c-495e-941b-ddd2b5acad43\") " Jul 21 14:57:24.822995 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:24.822899 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8671fbc8-8c2c-495e-941b-ddd2b5acad43-istio-token\") pod \"8671fbc8-8c2c-495e-941b-ddd2b5acad43\" (UID: \"8671fbc8-8c2c-495e-941b-ddd2b5acad43\") " Jul 21 14:57:24.822995 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:24.822972 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8671fbc8-8c2c-495e-941b-ddd2b5acad43-istio-data\") pod \"8671fbc8-8c2c-495e-941b-ddd2b5acad43\" (UID: \"8671fbc8-8c2c-495e-941b-ddd2b5acad43\") " Jul 21 14:57:24.823278 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:24.823114 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8671fbc8-8c2c-495e-941b-ddd2b5acad43-workload-certs\") pod \"8671fbc8-8c2c-495e-941b-ddd2b5acad43\" (UID: \"8671fbc8-8c2c-495e-941b-ddd2b5acad43\") " Jul 21 14:57:24.823278 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:24.823169 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8671fbc8-8c2c-495e-941b-ddd2b5acad43-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8671fbc8-8c2c-495e-941b-ddd2b5acad43" (UID: "8671fbc8-8c2c-495e-941b-ddd2b5acad43"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:57:24.823278 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:24.823178 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8671fbc8-8c2c-495e-941b-ddd2b5acad43-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8671fbc8-8c2c-495e-941b-ddd2b5acad43" (UID: "8671fbc8-8c2c-495e-941b-ddd2b5acad43"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 14:57:24.823526 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:24.823272 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8671fbc8-8c2c-495e-941b-ddd2b5acad43-workload-socket\") pod \"8671fbc8-8c2c-495e-941b-ddd2b5acad43\" (UID: \"8671fbc8-8c2c-495e-941b-ddd2b5acad43\") " Jul 21 14:57:24.823526 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:24.823321 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8671fbc8-8c2c-495e-941b-ddd2b5acad43-istio-podinfo\") pod \"8671fbc8-8c2c-495e-941b-ddd2b5acad43\" (UID: \"8671fbc8-8c2c-495e-941b-ddd2b5acad43\") " Jul 21 14:57:24.823526 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:24.823386 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8671fbc8-8c2c-495e-941b-ddd2b5acad43-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8671fbc8-8c2c-495e-941b-ddd2b5acad43" (UID: "8671fbc8-8c2c-495e-941b-ddd2b5acad43"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:57:24.823526 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:24.823511 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8671fbc8-8c2c-495e-941b-ddd2b5acad43-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8671fbc8-8c2c-495e-941b-ddd2b5acad43" (UID: "8671fbc8-8c2c-495e-941b-ddd2b5acad43"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:57:24.823734 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:24.823723 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8671fbc8-8c2c-495e-941b-ddd2b5acad43-workload-socket\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:57:24.823804 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:24.823744 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8671fbc8-8c2c-495e-941b-ddd2b5acad43-istiod-ca-cert\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:57:24.823804 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:24.823757 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8671fbc8-8c2c-495e-941b-ddd2b5acad43-credential-socket\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:57:24.823804 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:24.823771 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8671fbc8-8c2c-495e-941b-ddd2b5acad43-workload-certs\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:57:24.823973 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:24.823822 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8671fbc8-8c2c-495e-941b-ddd2b5acad43-istio-data" (OuterVolumeSpecName: "istio-data") pod "8671fbc8-8c2c-495e-941b-ddd2b5acad43" (UID: "8671fbc8-8c2c-495e-941b-ddd2b5acad43"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:57:24.825203 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:24.825173 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8671fbc8-8c2c-495e-941b-ddd2b5acad43-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8671fbc8-8c2c-495e-941b-ddd2b5acad43" (UID: "8671fbc8-8c2c-495e-941b-ddd2b5acad43"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:57:24.825363 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:24.825344 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8671fbc8-8c2c-495e-941b-ddd2b5acad43-istio-token" (OuterVolumeSpecName: "istio-token") pod "8671fbc8-8c2c-495e-941b-ddd2b5acad43" (UID: "8671fbc8-8c2c-495e-941b-ddd2b5acad43"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 14:57:24.825584 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:24.825561 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8671fbc8-8c2c-495e-941b-ddd2b5acad43-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8671fbc8-8c2c-495e-941b-ddd2b5acad43" (UID: "8671fbc8-8c2c-495e-941b-ddd2b5acad43"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 21 14:57:24.825584 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:24.825566 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8671fbc8-8c2c-495e-941b-ddd2b5acad43-kube-api-access-bslsd" (OuterVolumeSpecName: "kube-api-access-bslsd") pod "8671fbc8-8c2c-495e-941b-ddd2b5acad43" (UID: "8671fbc8-8c2c-495e-941b-ddd2b5acad43"). InnerVolumeSpecName "kube-api-access-bslsd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 14:57:24.925326 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:24.925283 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8671fbc8-8c2c-495e-941b-ddd2b5acad43-istio-podinfo\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:57:24.925326 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:24.925320 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8671fbc8-8c2c-495e-941b-ddd2b5acad43-istio-envoy\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:57:24.925326 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:24.925332 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bslsd\" (UniqueName: \"kubernetes.io/projected/8671fbc8-8c2c-495e-941b-ddd2b5acad43-kube-api-access-bslsd\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:57:24.925567 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:24.925341 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8671fbc8-8c2c-495e-941b-ddd2b5acad43-istio-token\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:57:24.925567 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:24.925352 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8671fbc8-8c2c-495e-941b-ddd2b5acad43-istio-data\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:57:25.294252 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:25.294213 2576 generic.go:356] "Generic (PLEG): container finished" podID="8671fbc8-8c2c-495e-941b-ddd2b5acad43" containerID="00141f1246dff7aa363aba68f680a05a404e786b9df10e852fb2d618337dfa94" exitCode=0 Jul 21 14:57:25.294252 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:25.294263 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx" Jul 21 14:57:25.294508 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:25.294301 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx" event={"ID":"8671fbc8-8c2c-495e-941b-ddd2b5acad43","Type":"ContainerDied","Data":"00141f1246dff7aa363aba68f680a05a404e786b9df10e852fb2d618337dfa94"} Jul 21 14:57:25.294508 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:25.294356 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx" event={"ID":"8671fbc8-8c2c-495e-941b-ddd2b5acad43","Type":"ContainerDied","Data":"a538ad6503b25b0553606dac113dec6193fa1afee7447b46151a532c4b97ddb3"} Jul 21 14:57:25.294508 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:25.294382 2576 scope.go:117] "RemoveContainer" containerID="00141f1246dff7aa363aba68f680a05a404e786b9df10e852fb2d618337dfa94" Jul 21 14:57:25.304682 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:25.304657 2576 scope.go:117] "RemoveContainer" containerID="d6c8d80283cc0cc9e0d19caddd9acc5b8258001995cf44e735abc4aaf0929a86" Jul 21 14:57:25.322220 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:25.322197 2576 scope.go:117] "RemoveContainer" containerID="00141f1246dff7aa363aba68f680a05a404e786b9df10e852fb2d618337dfa94" Jul 21 14:57:25.322545 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:57:25.322525 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00141f1246dff7aa363aba68f680a05a404e786b9df10e852fb2d618337dfa94\": container with ID starting with 00141f1246dff7aa363aba68f680a05a404e786b9df10e852fb2d618337dfa94 not found: ID does not exist" containerID="00141f1246dff7aa363aba68f680a05a404e786b9df10e852fb2d618337dfa94" Jul 21 14:57:25.322615 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:25.322555 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00141f1246dff7aa363aba68f680a05a404e786b9df10e852fb2d618337dfa94"} err="failed to get container status \"00141f1246dff7aa363aba68f680a05a404e786b9df10e852fb2d618337dfa94\": rpc error: code = NotFound desc = could not find container \"00141f1246dff7aa363aba68f680a05a404e786b9df10e852fb2d618337dfa94\": container with ID starting with 00141f1246dff7aa363aba68f680a05a404e786b9df10e852fb2d618337dfa94 not found: ID does not exist" Jul 21 14:57:25.322615 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:25.322577 2576 scope.go:117] "RemoveContainer" containerID="d6c8d80283cc0cc9e0d19caddd9acc5b8258001995cf44e735abc4aaf0929a86" Jul 21 14:57:25.322956 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:57:25.322935 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6c8d80283cc0cc9e0d19caddd9acc5b8258001995cf44e735abc4aaf0929a86\": container with ID starting with d6c8d80283cc0cc9e0d19caddd9acc5b8258001995cf44e735abc4aaf0929a86 not found: ID does not exist" containerID="d6c8d80283cc0cc9e0d19caddd9acc5b8258001995cf44e735abc4aaf0929a86" Jul 21 14:57:25.323043 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:25.322963 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6c8d80283cc0cc9e0d19caddd9acc5b8258001995cf44e735abc4aaf0929a86"} err="failed to get container status \"d6c8d80283cc0cc9e0d19caddd9acc5b8258001995cf44e735abc4aaf0929a86\": rpc error: code = NotFound desc = could not find container \"d6c8d80283cc0cc9e0d19caddd9acc5b8258001995cf44e735abc4aaf0929a86\": container with ID starting with d6c8d80283cc0cc9e0d19caddd9acc5b8258001995cf44e735abc4aaf0929a86 not found: ID does not exist" Jul 21 14:57:25.328316 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:25.328280 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx"] Jul 21 14:57:25.333042 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:25.333010 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-6c5a8f-openshift-default-7bd469b957-wf8gx"] Jul 21 14:57:25.526090 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:25.526047 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8671fbc8-8c2c-495e-941b-ddd2b5acad43" path="/var/lib/kubelet/pods/8671fbc8-8c2c-495e-941b-ddd2b5acad43/volumes" Jul 21 14:57:28.421105 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:28.421067 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x"] Jul 21 14:57:28.421604 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:28.421500 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8671fbc8-8c2c-495e-941b-ddd2b5acad43" containerName="istio-proxy" Jul 21 14:57:28.421604 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:28.421513 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8671fbc8-8c2c-495e-941b-ddd2b5acad43" containerName="istio-proxy" Jul 21 14:57:28.421604 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:28.421530 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8671fbc8-8c2c-495e-941b-ddd2b5acad43" containerName="istio-proxy" Jul 21 14:57:28.421604 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:28.421536 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8671fbc8-8c2c-495e-941b-ddd2b5acad43" containerName="istio-proxy" Jul 21 14:57:28.421735 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:28.421610 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8671fbc8-8c2c-495e-941b-ddd2b5acad43" containerName="istio-proxy" Jul 21 14:57:28.421735 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:28.421619 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8671fbc8-8c2c-495e-941b-ddd2b5acad43" containerName="istio-proxy" Jul 21 14:57:28.423797 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:28.423748 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x" Jul 21 14:57:28.426850 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:28.426822 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-63bc89-openshift-default-dockercfg-bb7q6\"" Jul 21 14:57:28.440658 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:28.440625 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x"] Jul 21 14:57:28.460094 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:28.460054 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b029413-e724-4a80-9e2b-30525e265989-istio-token\") pod \"e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x\" (UID: \"9b029413-e724-4a80-9e2b-30525e265989\") " pod="openshift-ingress/e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x" Jul 21 14:57:28.460289 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:28.460141 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b029413-e724-4a80-9e2b-30525e265989-workload-socket\") pod \"e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x\" (UID: \"9b029413-e724-4a80-9e2b-30525e265989\") " pod="openshift-ingress/e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x" Jul 21 14:57:28.460289 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:28.460201 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b029413-e724-4a80-9e2b-30525e265989-istio-envoy\") pod \"e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x\" (UID: \"9b029413-e724-4a80-9e2b-30525e265989\") " pod="openshift-ingress/e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x" Jul 21 14:57:28.460289 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:28.460227 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-js52h\" (UniqueName: \"kubernetes.io/projected/9b029413-e724-4a80-9e2b-30525e265989-kube-api-access-js52h\") pod \"e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x\" (UID: \"9b029413-e724-4a80-9e2b-30525e265989\") " pod="openshift-ingress/e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x" Jul 21 14:57:28.460289 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:28.460279 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b029413-e724-4a80-9e2b-30525e265989-workload-certs\") pod \"e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x\" (UID: \"9b029413-e724-4a80-9e2b-30525e265989\") " pod="openshift-ingress/e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x" Jul 21 14:57:28.460478 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:28.460392 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b029413-e724-4a80-9e2b-30525e265989-istio-podinfo\") pod \"e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x\" (UID: \"9b029413-e724-4a80-9e2b-30525e265989\") " pod="openshift-ingress/e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x" Jul 21 14:57:28.460478 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:28.460450 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b029413-e724-4a80-9e2b-30525e265989-credential-socket\") pod \"e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x\" (UID: \"9b029413-e724-4a80-9e2b-30525e265989\") " pod="openshift-ingress/e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x" Jul 21 14:57:28.460571 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:28.460489 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b029413-e724-4a80-9e2b-30525e265989-istiod-ca-cert\") pod \"e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x\" (UID: \"9b029413-e724-4a80-9e2b-30525e265989\") " pod="openshift-ingress/e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x" Jul 21 14:57:28.460571 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:28.460517 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b029413-e724-4a80-9e2b-30525e265989-istio-data\") pod \"e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x\" (UID: \"9b029413-e724-4a80-9e2b-30525e265989\") " pod="openshift-ingress/e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x" Jul 21 14:57:28.561417 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:28.561380 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b029413-e724-4a80-9e2b-30525e265989-istiod-ca-cert\") pod \"e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x\" (UID: \"9b029413-e724-4a80-9e2b-30525e265989\") " pod="openshift-ingress/e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x" Jul 21 14:57:28.561417 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:28.561418 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b029413-e724-4a80-9e2b-30525e265989-istio-data\") pod \"e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x\" (UID: \"9b029413-e724-4a80-9e2b-30525e265989\") " pod="openshift-ingress/e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x" Jul 21 14:57:28.561683 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:28.561439 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b029413-e724-4a80-9e2b-30525e265989-istio-token\") pod \"e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x\" (UID: \"9b029413-e724-4a80-9e2b-30525e265989\") " pod="openshift-ingress/e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x" Jul 21 14:57:28.561683 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:28.561479 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b029413-e724-4a80-9e2b-30525e265989-workload-socket\") pod \"e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x\" (UID: \"9b029413-e724-4a80-9e2b-30525e265989\") " pod="openshift-ingress/e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x" Jul 21 14:57:28.561683 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:28.561523 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b029413-e724-4a80-9e2b-30525e265989-istio-envoy\") pod \"e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x\" (UID: \"9b029413-e724-4a80-9e2b-30525e265989\") " pod="openshift-ingress/e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x" Jul 21 14:57:28.561683 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:28.561545 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-js52h\" (UniqueName: \"kubernetes.io/projected/9b029413-e724-4a80-9e2b-30525e265989-kube-api-access-js52h\") pod \"e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x\" (UID: \"9b029413-e724-4a80-9e2b-30525e265989\") " pod="openshift-ingress/e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x" Jul 21 14:57:28.561683 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:28.561597 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b029413-e724-4a80-9e2b-30525e265989-workload-certs\") pod \"e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x\" (UID: \"9b029413-e724-4a80-9e2b-30525e265989\") " pod="openshift-ingress/e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x" Jul 21 14:57:28.561683 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:28.561666 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b029413-e724-4a80-9e2b-30525e265989-istio-podinfo\") pod \"e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x\" (UID: \"9b029413-e724-4a80-9e2b-30525e265989\") " pod="openshift-ingress/e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x" Jul 21 14:57:28.562023 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:28.561710 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b029413-e724-4a80-9e2b-30525e265989-credential-socket\") pod \"e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x\" (UID: \"9b029413-e724-4a80-9e2b-30525e265989\") " pod="openshift-ingress/e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x" Jul 21 14:57:28.562023 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:28.561952 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b029413-e724-4a80-9e2b-30525e265989-workload-socket\") pod \"e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x\" (UID: \"9b029413-e724-4a80-9e2b-30525e265989\") " pod="openshift-ingress/e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x" Jul 21 14:57:28.562097 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:28.562030 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b029413-e724-4a80-9e2b-30525e265989-workload-certs\") pod \"e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x\" (UID: \"9b029413-e724-4a80-9e2b-30525e265989\") " pod="openshift-ingress/e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x" Jul 21 14:57:28.562138 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:28.562090 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b029413-e724-4a80-9e2b-30525e265989-credential-socket\") pod \"e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x\" (UID: \"9b029413-e724-4a80-9e2b-30525e265989\") " pod="openshift-ingress/e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x" Jul 21 14:57:28.562192 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:28.562177 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b029413-e724-4a80-9e2b-30525e265989-istio-data\") pod \"e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x\" (UID: \"9b029413-e724-4a80-9e2b-30525e265989\") " pod="openshift-ingress/e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x" Jul 21 14:57:28.562335 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:28.562316 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b029413-e724-4a80-9e2b-30525e265989-istiod-ca-cert\") pod \"e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x\" (UID: \"9b029413-e724-4a80-9e2b-30525e265989\") " pod="openshift-ingress/e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x" Jul 21 14:57:28.563907 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:28.563886 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b029413-e724-4a80-9e2b-30525e265989-istio-envoy\") pod \"e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x\" (UID: \"9b029413-e724-4a80-9e2b-30525e265989\") " pod="openshift-ingress/e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x" Jul 21 14:57:28.564120 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:28.564104 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b029413-e724-4a80-9e2b-30525e265989-istio-podinfo\") pod \"e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x\" (UID: \"9b029413-e724-4a80-9e2b-30525e265989\") " pod="openshift-ingress/e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x" Jul 21 14:57:28.571552 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:28.571527 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b029413-e724-4a80-9e2b-30525e265989-istio-token\") pod \"e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x\" (UID: \"9b029413-e724-4a80-9e2b-30525e265989\") " pod="openshift-ingress/e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x" Jul 21 14:57:28.572042 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:28.572020 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-js52h\" (UniqueName: \"kubernetes.io/projected/9b029413-e724-4a80-9e2b-30525e265989-kube-api-access-js52h\") pod \"e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x\" (UID: \"9b029413-e724-4a80-9e2b-30525e265989\") " pod="openshift-ingress/e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x" Jul 21 14:57:28.735182 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:28.735080 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x" Jul 21 14:57:28.914442 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:28.914290 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x"] Jul 21 14:57:28.923806 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:57:28.923755 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b029413_e724_4a80_9e2b_30525e265989.slice/crio-ee23aa3ae61b0467d98e8831a5b371675d072b64bbd7bb4dc2b0a66c2d75ead4 WatchSource:0}: Error finding container ee23aa3ae61b0467d98e8831a5b371675d072b64bbd7bb4dc2b0a66c2d75ead4: Status 404 returned error can't find the container with id ee23aa3ae61b0467d98e8831a5b371675d072b64bbd7bb4dc2b0a66c2d75ead4 Jul 21 14:57:28.925999 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:28.925954 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:57:28.926089 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:28.926055 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:57:28.926129 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:28.926096 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:57:29.322874 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:29.322747 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x" event={"ID":"9b029413-e724-4a80-9e2b-30525e265989","Type":"ContainerStarted","Data":"c31d843b951be8a009a9ab70c46aa037e4a5dc8a272fdcccbe97099772825a0a"} Jul 21 14:57:29.322874 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:29.322845 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x" event={"ID":"9b029413-e724-4a80-9e2b-30525e265989","Type":"ContainerStarted","Data":"ee23aa3ae61b0467d98e8831a5b371675d072b64bbd7bb4dc2b0a66c2d75ead4"} Jul 21 14:57:29.346573 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:29.346508 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x" podStartSLOduration=1.346491143 podStartE2EDuration="1.346491143s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:57:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:57:29.344588965 +0000 UTC m=+2376.362492542" watchObservedRunningTime="2026-07-21 14:57:29.346491143 +0000 UTC m=+2376.364394718" Jul 21 14:57:29.735549 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:29.735449 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x" Jul 21 14:57:29.740870 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:29.740842 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x" Jul 21 14:57:30.328626 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:30.328589 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x" Jul 21 14:57:30.329843 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:30.329814 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x" Jul 21 14:57:36.363717 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:36.363679 2576 generic.go:356] "Generic (PLEG): container finished" podID="0daad0f6-785c-4149-bfba-7543db2d2e4f" containerID="0001af7a19e90c46ab17d88a744a620b00a175d9246be5e0ed6f10abd4ff9ecf" exitCode=0 Jul 21 14:57:36.364176 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:36.363753 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf" event={"ID":"0daad0f6-785c-4149-bfba-7543db2d2e4f","Type":"ContainerDied","Data":"0001af7a19e90c46ab17d88a744a620b00a175d9246be5e0ed6f10abd4ff9ecf"} Jul 21 14:57:36.364268 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:36.364249 2576 scope.go:117] "RemoveContainer" containerID="0001af7a19e90c46ab17d88a744a620b00a175d9246be5e0ed6f10abd4ff9ecf" Jul 21 14:57:36.365393 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:36.365361 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:57:36.365473 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:36.365440 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:57:36.365520 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:36.365475 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:57:37.272764 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:37.272718 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf" Jul 21 14:57:37.371496 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:37.371460 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf" event={"ID":"0daad0f6-785c-4149-bfba-7543db2d2e4f","Type":"ContainerStarted","Data":"7e314319cc6a3659494d991311d880efc121edc49dbe78cce1173ddce6ebfe36"} Jul 21 14:57:37.707435 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:37.707330 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf" Jul 21 14:57:37.707856 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:37.707829 2576 patch_prober.go:28] interesting pod/e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body= Jul 21 14:57:37.708062 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:37.708034 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf" podUID="0daad0f6-785c-4149-bfba-7543db2d2e4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" Jul 21 14:57:38.706428 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:38.706380 2576 patch_prober.go:28] interesting pod/e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body= Jul 21 14:57:38.707130 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:38.707090 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf" podUID="0daad0f6-785c-4149-bfba-7543db2d2e4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" Jul 21 14:57:39.706513 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:39.706463 2576 patch_prober.go:28] interesting pod/e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body= Jul 21 14:57:39.707205 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:39.707169 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf" podUID="0daad0f6-785c-4149-bfba-7543db2d2e4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" Jul 21 14:57:40.706647 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:40.706602 2576 patch_prober.go:28] interesting pod/e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body= Jul 21 14:57:40.707339 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:40.707299 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf" podUID="0daad0f6-785c-4149-bfba-7543db2d2e4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" Jul 21 14:57:41.717007 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:41.716964 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf" Jul 21 14:57:41.718814 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:41.718764 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf" Jul 21 14:57:41.721596 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:41.721548 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf" Jul 21 14:57:45.330211 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:45.330173 2576 patch_prober.go:28] interesting pod/e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body= Jul 21 14:57:45.330647 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:45.330233 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x" podUID="9b029413-e724-4a80-9e2b-30525e265989" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" Jul 21 14:57:45.444180 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:45.444146 2576 generic.go:356] "Generic (PLEG): container finished" podID="9b029413-e724-4a80-9e2b-30525e265989" containerID="c31d843b951be8a009a9ab70c46aa037e4a5dc8a272fdcccbe97099772825a0a" exitCode=0 Jul 21 14:57:45.444354 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:45.444218 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x" event={"ID":"9b029413-e724-4a80-9e2b-30525e265989","Type":"ContainerDied","Data":"c31d843b951be8a009a9ab70c46aa037e4a5dc8a272fdcccbe97099772825a0a"} Jul 21 14:57:45.444762 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:45.444744 2576 scope.go:117] "RemoveContainer" containerID="c31d843b951be8a009a9ab70c46aa037e4a5dc8a272fdcccbe97099772825a0a" Jul 21 14:57:45.445917 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:45.445884 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:57:45.445991 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:45.445976 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:57:45.446031 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:45.446017 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:57:46.451964 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:46.451919 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x" event={"ID":"9b029413-e724-4a80-9e2b-30525e265989","Type":"ContainerStarted","Data":"c5d7a7236170a73646db3c06e00187a0f5272fc60724fcdfa25c89a7dc813b90"} Jul 21 14:57:46.736137 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:46.736025 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x" Jul 21 14:57:46.736324 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:46.736301 2576 patch_prober.go:28] interesting pod/e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body= Jul 21 14:57:46.736379 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:46.736352 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x" podUID="9b029413-e724-4a80-9e2b-30525e265989" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" Jul 21 14:57:47.736246 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:47.736203 2576 patch_prober.go:28] interesting pod/e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body= Jul 21 14:57:47.736714 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:47.736266 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x" podUID="9b029413-e724-4a80-9e2b-30525e265989" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" Jul 21 14:57:48.736419 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:48.736377 2576 patch_prober.go:28] interesting pod/e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body= Jul 21 14:57:48.736889 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:48.736436 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x" podUID="9b029413-e724-4a80-9e2b-30525e265989" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" Jul 21 14:57:49.736281 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:49.736237 2576 patch_prober.go:28] interesting pod/e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body= Jul 21 14:57:49.736476 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:49.736299 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x" podUID="9b029413-e724-4a80-9e2b-30525e265989" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" Jul 21 14:57:50.740336 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:50.740306 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x" Jul 21 14:57:50.740755 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:50.740679 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x" Jul 21 14:57:50.741383 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:57:50.741368 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x" Jul 21 14:58:10.802731 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:10.802695 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf"] Jul 21 14:58:10.803347 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:10.802946 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf" podUID="0daad0f6-785c-4149-bfba-7543db2d2e4f" containerName="istio-proxy" containerID="cri-o://7e314319cc6a3659494d991311d880efc121edc49dbe78cce1173ddce6ebfe36" gracePeriod=30 Jul 21 14:58:11.721377 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:11.721342 2576 patch_prober.go:28] interesting pod/e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 21 14:58:11.721556 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:11.721409 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf" podUID="0daad0f6-785c-4149-bfba-7543db2d2e4f" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 21 14:58:16.064043 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:16.063973 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf" Jul 21 14:58:16.164549 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:16.164513 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0daad0f6-785c-4149-bfba-7543db2d2e4f-credential-socket\") pod \"0daad0f6-785c-4149-bfba-7543db2d2e4f\" (UID: \"0daad0f6-785c-4149-bfba-7543db2d2e4f\") " Jul 21 14:58:16.164747 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:16.164571 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0daad0f6-785c-4149-bfba-7543db2d2e4f-istio-podinfo\") pod \"0daad0f6-785c-4149-bfba-7543db2d2e4f\" (UID: \"0daad0f6-785c-4149-bfba-7543db2d2e4f\") " Jul 21 14:58:16.164747 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:16.164615 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0daad0f6-785c-4149-bfba-7543db2d2e4f-istiod-ca-cert\") pod \"0daad0f6-785c-4149-bfba-7543db2d2e4f\" (UID: \"0daad0f6-785c-4149-bfba-7543db2d2e4f\") " Jul 21 14:58:16.164747 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:16.164638 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0daad0f6-785c-4149-bfba-7543db2d2e4f-istio-envoy\") pod \"0daad0f6-785c-4149-bfba-7543db2d2e4f\" (UID: \"0daad0f6-785c-4149-bfba-7543db2d2e4f\") " Jul 21 14:58:16.164747 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:16.164670 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hpxz7\" (UniqueName: \"kubernetes.io/projected/0daad0f6-785c-4149-bfba-7543db2d2e4f-kube-api-access-hpxz7\") pod \"0daad0f6-785c-4149-bfba-7543db2d2e4f\" (UID: \"0daad0f6-785c-4149-bfba-7543db2d2e4f\") " Jul 21 14:58:16.164747 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:16.164706 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0daad0f6-785c-4149-bfba-7543db2d2e4f-istio-token\") pod \"0daad0f6-785c-4149-bfba-7543db2d2e4f\" (UID: \"0daad0f6-785c-4149-bfba-7543db2d2e4f\") " Jul 21 14:58:16.164747 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:16.164731 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0daad0f6-785c-4149-bfba-7543db2d2e4f-istio-data\") pod \"0daad0f6-785c-4149-bfba-7543db2d2e4f\" (UID: \"0daad0f6-785c-4149-bfba-7543db2d2e4f\") " Jul 21 14:58:16.165106 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:16.164759 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0daad0f6-785c-4149-bfba-7543db2d2e4f-workload-socket\") pod \"0daad0f6-785c-4149-bfba-7543db2d2e4f\" (UID: \"0daad0f6-785c-4149-bfba-7543db2d2e4f\") " Jul 21 14:58:16.165106 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:16.164827 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0daad0f6-785c-4149-bfba-7543db2d2e4f-workload-certs\") pod \"0daad0f6-785c-4149-bfba-7543db2d2e4f\" (UID: \"0daad0f6-785c-4149-bfba-7543db2d2e4f\") " Jul 21 14:58:16.165106 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:16.164879 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0daad0f6-785c-4149-bfba-7543db2d2e4f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0daad0f6-785c-4149-bfba-7543db2d2e4f" (UID: "0daad0f6-785c-4149-bfba-7543db2d2e4f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:58:16.165305 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:16.165148 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0daad0f6-785c-4149-bfba-7543db2d2e4f-credential-socket\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:58:16.165305 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:16.165180 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0daad0f6-785c-4149-bfba-7543db2d2e4f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0daad0f6-785c-4149-bfba-7543db2d2e4f" (UID: "0daad0f6-785c-4149-bfba-7543db2d2e4f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 14:58:16.165415 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:16.165303 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0daad0f6-785c-4149-bfba-7543db2d2e4f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0daad0f6-785c-4149-bfba-7543db2d2e4f" (UID: "0daad0f6-785c-4149-bfba-7543db2d2e4f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:58:16.165735 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:16.165710 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0daad0f6-785c-4149-bfba-7543db2d2e4f-istio-data" (OuterVolumeSpecName: "istio-data") pod "0daad0f6-785c-4149-bfba-7543db2d2e4f" (UID: "0daad0f6-785c-4149-bfba-7543db2d2e4f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:58:16.165908 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:16.165865 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0daad0f6-785c-4149-bfba-7543db2d2e4f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0daad0f6-785c-4149-bfba-7543db2d2e4f" (UID: "0daad0f6-785c-4149-bfba-7543db2d2e4f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:58:16.167236 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:16.167211 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0daad0f6-785c-4149-bfba-7543db2d2e4f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0daad0f6-785c-4149-bfba-7543db2d2e4f" (UID: "0daad0f6-785c-4149-bfba-7543db2d2e4f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 21 14:58:16.167341 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:16.167300 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0daad0f6-785c-4149-bfba-7543db2d2e4f-istio-token" (OuterVolumeSpecName: "istio-token") pod "0daad0f6-785c-4149-bfba-7543db2d2e4f" (UID: "0daad0f6-785c-4149-bfba-7543db2d2e4f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 14:58:16.167412 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:16.167388 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0daad0f6-785c-4149-bfba-7543db2d2e4f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0daad0f6-785c-4149-bfba-7543db2d2e4f" (UID: "0daad0f6-785c-4149-bfba-7543db2d2e4f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:58:16.167466 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:16.167428 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0daad0f6-785c-4149-bfba-7543db2d2e4f-kube-api-access-hpxz7" (OuterVolumeSpecName: "kube-api-access-hpxz7") pod "0daad0f6-785c-4149-bfba-7543db2d2e4f" (UID: "0daad0f6-785c-4149-bfba-7543db2d2e4f"). InnerVolumeSpecName "kube-api-access-hpxz7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 14:58:16.266436 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:16.266397 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0daad0f6-785c-4149-bfba-7543db2d2e4f-workload-certs\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:58:16.266436 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:16.266427 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0daad0f6-785c-4149-bfba-7543db2d2e4f-istio-podinfo\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:58:16.266436 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:16.266436 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0daad0f6-785c-4149-bfba-7543db2d2e4f-istiod-ca-cert\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:58:16.266436 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:16.266447 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0daad0f6-785c-4149-bfba-7543db2d2e4f-istio-envoy\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:58:16.266708 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:16.266457 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hpxz7\" (UniqueName: \"kubernetes.io/projected/0daad0f6-785c-4149-bfba-7543db2d2e4f-kube-api-access-hpxz7\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:58:16.266708 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:16.266465 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0daad0f6-785c-4149-bfba-7543db2d2e4f-istio-token\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:58:16.266708 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:16.266474 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0daad0f6-785c-4149-bfba-7543db2d2e4f-istio-data\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:58:16.266708 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:16.266482 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0daad0f6-785c-4149-bfba-7543db2d2e4f-workload-socket\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:58:16.624853 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:16.624819 2576 generic.go:356] "Generic (PLEG): container finished" podID="0daad0f6-785c-4149-bfba-7543db2d2e4f" containerID="7e314319cc6a3659494d991311d880efc121edc49dbe78cce1173ddce6ebfe36" exitCode=0 Jul 21 14:58:16.625036 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:16.624874 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf" Jul 21 14:58:16.625036 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:16.624908 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf" event={"ID":"0daad0f6-785c-4149-bfba-7543db2d2e4f","Type":"ContainerDied","Data":"7e314319cc6a3659494d991311d880efc121edc49dbe78cce1173ddce6ebfe36"} Jul 21 14:58:16.625036 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:16.624967 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf" event={"ID":"0daad0f6-785c-4149-bfba-7543db2d2e4f","Type":"ContainerDied","Data":"481c84ccdc5e1faa5384d0b2c6a4f2f2a58efadf0ffa3cd2d80f31298589ca64"} Jul 21 14:58:16.625036 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:16.624998 2576 scope.go:117] "RemoveContainer" containerID="7e314319cc6a3659494d991311d880efc121edc49dbe78cce1173ddce6ebfe36" Jul 21 14:58:16.634947 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:16.634921 2576 scope.go:117] "RemoveContainer" containerID="0001af7a19e90c46ab17d88a744a620b00a175d9246be5e0ed6f10abd4ff9ecf" Jul 21 14:58:16.643470 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:16.643450 2576 scope.go:117] "RemoveContainer" containerID="7e314319cc6a3659494d991311d880efc121edc49dbe78cce1173ddce6ebfe36" Jul 21 14:58:16.643796 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:58:16.643754 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e314319cc6a3659494d991311d880efc121edc49dbe78cce1173ddce6ebfe36\": container with ID starting with 7e314319cc6a3659494d991311d880efc121edc49dbe78cce1173ddce6ebfe36 not found: ID does not exist" containerID="7e314319cc6a3659494d991311d880efc121edc49dbe78cce1173ddce6ebfe36" Jul 21 14:58:16.643843 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:16.643802 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e314319cc6a3659494d991311d880efc121edc49dbe78cce1173ddce6ebfe36"} err="failed to get container status \"7e314319cc6a3659494d991311d880efc121edc49dbe78cce1173ddce6ebfe36\": rpc error: code = NotFound desc = could not find container \"7e314319cc6a3659494d991311d880efc121edc49dbe78cce1173ddce6ebfe36\": container with ID starting with 7e314319cc6a3659494d991311d880efc121edc49dbe78cce1173ddce6ebfe36 not found: ID does not exist" Jul 21 14:58:16.643843 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:16.643823 2576 scope.go:117] "RemoveContainer" containerID="0001af7a19e90c46ab17d88a744a620b00a175d9246be5e0ed6f10abd4ff9ecf" Jul 21 14:58:16.644064 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:58:16.644049 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0001af7a19e90c46ab17d88a744a620b00a175d9246be5e0ed6f10abd4ff9ecf\": container with ID starting with 0001af7a19e90c46ab17d88a744a620b00a175d9246be5e0ed6f10abd4ff9ecf not found: ID does not exist" containerID="0001af7a19e90c46ab17d88a744a620b00a175d9246be5e0ed6f10abd4ff9ecf" Jul 21 14:58:16.644107 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:16.644070 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0001af7a19e90c46ab17d88a744a620b00a175d9246be5e0ed6f10abd4ff9ecf"} err="failed to get container status \"0001af7a19e90c46ab17d88a744a620b00a175d9246be5e0ed6f10abd4ff9ecf\": rpc error: code = NotFound desc = could not find container \"0001af7a19e90c46ab17d88a744a620b00a175d9246be5e0ed6f10abd4ff9ecf\": container with ID starting with 0001af7a19e90c46ab17d88a744a620b00a175d9246be5e0ed6f10abd4ff9ecf not found: ID does not exist" Jul 21 14:58:16.654066 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:16.654037 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf"] Jul 21 14:58:16.660498 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:16.660467 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-6ecdf5-openshift-default-7b7d7d67b9-qbbvf"] Jul 21 14:58:17.525460 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:17.525427 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0daad0f6-785c-4149-bfba-7543db2d2e4f" path="/var/lib/kubelet/pods/0daad0f6-785c-4149-bfba-7543db2d2e4f/volumes" Jul 21 14:58:39.084715 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:39.084670 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x"] Jul 21 14:58:39.085155 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:39.084939 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x" podUID="9b029413-e724-4a80-9e2b-30525e265989" containerName="istio-proxy" containerID="cri-o://c5d7a7236170a73646db3c06e00187a0f5272fc60724fcdfa25c89a7dc813b90" gracePeriod=30 Jul 21 14:58:40.055506 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:40.055458 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj"] Jul 21 14:58:40.055892 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:40.055878 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0daad0f6-785c-4149-bfba-7543db2d2e4f" containerName="istio-proxy" Jul 21 14:58:40.055943 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:40.055894 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0daad0f6-785c-4149-bfba-7543db2d2e4f" containerName="istio-proxy" Jul 21 14:58:40.055986 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:40.055976 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="0daad0f6-785c-4149-bfba-7543db2d2e4f" containerName="istio-proxy" Jul 21 14:58:40.056021 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:40.055987 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="0daad0f6-785c-4149-bfba-7543db2d2e4f" containerName="istio-proxy" Jul 21 14:58:40.059106 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:40.059089 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj" Jul 21 14:58:40.062138 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:40.062115 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-d89949-openshift-default-dockercfg-s8tcm\"" Jul 21 14:58:40.074575 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:40.074540 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj"] Jul 21 14:58:40.195358 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:40.195310 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4aa1c92-4af0-4b8b-a7b8-d322c4904370-workload-certs\") pod \"e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj\" (UID: \"b4aa1c92-4af0-4b8b-a7b8-d322c4904370\") " pod="openshift-ingress/e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj" Jul 21 14:58:40.195894 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:40.195387 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4aa1c92-4af0-4b8b-a7b8-d322c4904370-istiod-ca-cert\") pod \"e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj\" (UID: \"b4aa1c92-4af0-4b8b-a7b8-d322c4904370\") " pod="openshift-ingress/e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj" Jul 21 14:58:40.195894 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:40.195422 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4aa1c92-4af0-4b8b-a7b8-d322c4904370-istio-data\") pod \"e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj\" (UID: \"b4aa1c92-4af0-4b8b-a7b8-d322c4904370\") " pod="openshift-ingress/e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj" Jul 21 14:58:40.195894 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:40.195495 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4aa1c92-4af0-4b8b-a7b8-d322c4904370-istio-podinfo\") pod \"e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj\" (UID: \"b4aa1c92-4af0-4b8b-a7b8-d322c4904370\") " pod="openshift-ingress/e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj" Jul 21 14:58:40.195894 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:40.195530 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-678s6\" (UniqueName: \"kubernetes.io/projected/b4aa1c92-4af0-4b8b-a7b8-d322c4904370-kube-api-access-678s6\") pod \"e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj\" (UID: \"b4aa1c92-4af0-4b8b-a7b8-d322c4904370\") " pod="openshift-ingress/e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj" Jul 21 14:58:40.195894 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:40.195560 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4aa1c92-4af0-4b8b-a7b8-d322c4904370-workload-socket\") pod \"e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj\" (UID: \"b4aa1c92-4af0-4b8b-a7b8-d322c4904370\") " pod="openshift-ingress/e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj" Jul 21 14:58:40.195894 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:40.195606 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4aa1c92-4af0-4b8b-a7b8-d322c4904370-credential-socket\") pod \"e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj\" (UID: \"b4aa1c92-4af0-4b8b-a7b8-d322c4904370\") " pod="openshift-ingress/e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj" Jul 21 14:58:40.195894 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:40.195634 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4aa1c92-4af0-4b8b-a7b8-d322c4904370-istio-envoy\") pod \"e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj\" (UID: \"b4aa1c92-4af0-4b8b-a7b8-d322c4904370\") " pod="openshift-ingress/e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj" Jul 21 14:58:40.195894 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:40.195686 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4aa1c92-4af0-4b8b-a7b8-d322c4904370-istio-token\") pod \"e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj\" (UID: \"b4aa1c92-4af0-4b8b-a7b8-d322c4904370\") " pod="openshift-ingress/e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj" Jul 21 14:58:40.296893 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:40.296848 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4aa1c92-4af0-4b8b-a7b8-d322c4904370-istio-envoy\") pod \"e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj\" (UID: \"b4aa1c92-4af0-4b8b-a7b8-d322c4904370\") " pod="openshift-ingress/e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj" Jul 21 14:58:40.296893 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:40.296896 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4aa1c92-4af0-4b8b-a7b8-d322c4904370-istio-token\") pod \"e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj\" (UID: \"b4aa1c92-4af0-4b8b-a7b8-d322c4904370\") " pod="openshift-ingress/e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj" Jul 21 14:58:40.297189 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:40.296965 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4aa1c92-4af0-4b8b-a7b8-d322c4904370-workload-certs\") pod \"e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj\" (UID: \"b4aa1c92-4af0-4b8b-a7b8-d322c4904370\") " pod="openshift-ingress/e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj" Jul 21 14:58:40.297189 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:40.297024 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4aa1c92-4af0-4b8b-a7b8-d322c4904370-istiod-ca-cert\") pod \"e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj\" (UID: \"b4aa1c92-4af0-4b8b-a7b8-d322c4904370\") " pod="openshift-ingress/e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj" Jul 21 14:58:40.297189 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:40.297098 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4aa1c92-4af0-4b8b-a7b8-d322c4904370-istio-data\") pod \"e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj\" (UID: \"b4aa1c92-4af0-4b8b-a7b8-d322c4904370\") " pod="openshift-ingress/e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj" Jul 21 14:58:40.297189 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:40.297154 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4aa1c92-4af0-4b8b-a7b8-d322c4904370-istio-podinfo\") pod \"e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj\" (UID: \"b4aa1c92-4af0-4b8b-a7b8-d322c4904370\") " pod="openshift-ingress/e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj" Jul 21 14:58:40.297408 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:40.297291 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-678s6\" (UniqueName: \"kubernetes.io/projected/b4aa1c92-4af0-4b8b-a7b8-d322c4904370-kube-api-access-678s6\") pod \"e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj\" (UID: \"b4aa1c92-4af0-4b8b-a7b8-d322c4904370\") " pod="openshift-ingress/e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj" Jul 21 14:58:40.297408 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:40.297360 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4aa1c92-4af0-4b8b-a7b8-d322c4904370-workload-socket\") pod \"e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj\" (UID: \"b4aa1c92-4af0-4b8b-a7b8-d322c4904370\") " pod="openshift-ingress/e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj" Jul 21 14:58:40.297408 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:40.297402 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4aa1c92-4af0-4b8b-a7b8-d322c4904370-credential-socket\") pod \"e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj\" (UID: \"b4aa1c92-4af0-4b8b-a7b8-d322c4904370\") " pod="openshift-ingress/e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj" Jul 21 14:58:40.297570 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:40.297412 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4aa1c92-4af0-4b8b-a7b8-d322c4904370-workload-certs\") pod \"e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj\" (UID: \"b4aa1c92-4af0-4b8b-a7b8-d322c4904370\") " pod="openshift-ingress/e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj" Jul 21 14:58:40.297570 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:40.297501 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4aa1c92-4af0-4b8b-a7b8-d322c4904370-istio-data\") pod \"e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj\" (UID: \"b4aa1c92-4af0-4b8b-a7b8-d322c4904370\") " pod="openshift-ingress/e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj" Jul 21 14:58:40.297741 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:40.297714 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4aa1c92-4af0-4b8b-a7b8-d322c4904370-workload-socket\") pod \"e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj\" (UID: \"b4aa1c92-4af0-4b8b-a7b8-d322c4904370\") " pod="openshift-ingress/e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj" Jul 21 14:58:40.297899 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:40.297760 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4aa1c92-4af0-4b8b-a7b8-d322c4904370-credential-socket\") pod \"e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj\" (UID: \"b4aa1c92-4af0-4b8b-a7b8-d322c4904370\") " pod="openshift-ingress/e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj" Jul 21 14:58:40.297899 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:40.297858 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4aa1c92-4af0-4b8b-a7b8-d322c4904370-istiod-ca-cert\") pod \"e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj\" (UID: \"b4aa1c92-4af0-4b8b-a7b8-d322c4904370\") " pod="openshift-ingress/e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj" Jul 21 14:58:40.299483 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:40.299464 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4aa1c92-4af0-4b8b-a7b8-d322c4904370-istio-envoy\") pod \"e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj\" (UID: \"b4aa1c92-4af0-4b8b-a7b8-d322c4904370\") " pod="openshift-ingress/e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj" Jul 21 14:58:40.299691 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:40.299674 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4aa1c92-4af0-4b8b-a7b8-d322c4904370-istio-podinfo\") pod \"e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj\" (UID: \"b4aa1c92-4af0-4b8b-a7b8-d322c4904370\") " pod="openshift-ingress/e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj" Jul 21 14:58:40.307905 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:40.307832 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4aa1c92-4af0-4b8b-a7b8-d322c4904370-istio-token\") pod \"e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj\" (UID: \"b4aa1c92-4af0-4b8b-a7b8-d322c4904370\") " pod="openshift-ingress/e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj" Jul 21 14:58:40.308090 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:40.308066 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-678s6\" (UniqueName: \"kubernetes.io/projected/b4aa1c92-4af0-4b8b-a7b8-d322c4904370-kube-api-access-678s6\") pod \"e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj\" (UID: \"b4aa1c92-4af0-4b8b-a7b8-d322c4904370\") " pod="openshift-ingress/e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj" Jul 21 14:58:40.370445 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:40.370389 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj" Jul 21 14:58:40.535468 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:40.535437 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj"] Jul 21 14:58:40.536404 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:58:40.536379 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4aa1c92_4af0_4b8b_a7b8_d322c4904370.slice/crio-947a2005335848d24efc5126087d45c169fc23a957d62c2bc0946d3e8cb728e5 WatchSource:0}: Error finding container 947a2005335848d24efc5126087d45c169fc23a957d62c2bc0946d3e8cb728e5: Status 404 returned error can't find the container with id 947a2005335848d24efc5126087d45c169fc23a957d62c2bc0946d3e8cb728e5 Jul 21 14:58:40.538610 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:40.538579 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:58:40.538710 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:40.538646 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:58:40.538710 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:40.538673 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:58:40.760373 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:40.760331 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj" event={"ID":"b4aa1c92-4af0-4b8b-a7b8-d322c4904370","Type":"ContainerStarted","Data":"7c0e811bb7b1fca55c70d4749fc9aab00b71ce12f348383049ad53964f08d2c4"} Jul 21 14:58:40.760562 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:40.760402 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj" event={"ID":"b4aa1c92-4af0-4b8b-a7b8-d322c4904370","Type":"ContainerStarted","Data":"947a2005335848d24efc5126087d45c169fc23a957d62c2bc0946d3e8cb728e5"} Jul 21 14:58:40.789579 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:40.789515 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj" podStartSLOduration=0.78949096 podStartE2EDuration="789.49096ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:58:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:58:40.788159609 +0000 UTC m=+2447.806063185" watchObservedRunningTime="2026-07-21 14:58:40.78949096 +0000 UTC m=+2447.807394535" Jul 21 14:58:41.371166 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:41.371127 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj" Jul 21 14:58:41.376057 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:41.376031 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj" Jul 21 14:58:41.766202 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:41.766171 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj" Jul 21 14:58:41.767360 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:41.767338 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj" Jul 21 14:58:44.356210 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:44.356141 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x" Jul 21 14:58:44.441189 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:44.441154 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b029413-e724-4a80-9e2b-30525e265989-istio-envoy\") pod \"9b029413-e724-4a80-9e2b-30525e265989\" (UID: \"9b029413-e724-4a80-9e2b-30525e265989\") " Jul 21 14:58:44.441189 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:44.441211 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b029413-e724-4a80-9e2b-30525e265989-istiod-ca-cert\") pod \"9b029413-e724-4a80-9e2b-30525e265989\" (UID: \"9b029413-e724-4a80-9e2b-30525e265989\") " Jul 21 14:58:44.441457 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:44.441239 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b029413-e724-4a80-9e2b-30525e265989-workload-certs\") pod \"9b029413-e724-4a80-9e2b-30525e265989\" (UID: \"9b029413-e724-4a80-9e2b-30525e265989\") " Jul 21 14:58:44.441457 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:44.441276 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-js52h\" (UniqueName: \"kubernetes.io/projected/9b029413-e724-4a80-9e2b-30525e265989-kube-api-access-js52h\") pod \"9b029413-e724-4a80-9e2b-30525e265989\" (UID: \"9b029413-e724-4a80-9e2b-30525e265989\") " Jul 21 14:58:44.441457 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:44.441296 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b029413-e724-4a80-9e2b-30525e265989-credential-socket\") pod \"9b029413-e724-4a80-9e2b-30525e265989\" (UID: \"9b029413-e724-4a80-9e2b-30525e265989\") " Jul 21 14:58:44.441457 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:44.441355 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b029413-e724-4a80-9e2b-30525e265989-istio-data\") pod \"9b029413-e724-4a80-9e2b-30525e265989\" (UID: \"9b029413-e724-4a80-9e2b-30525e265989\") " Jul 21 14:58:44.441457 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:44.441392 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b029413-e724-4a80-9e2b-30525e265989-istio-token\") pod \"9b029413-e724-4a80-9e2b-30525e265989\" (UID: \"9b029413-e724-4a80-9e2b-30525e265989\") " Jul 21 14:58:44.441457 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:44.441438 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b029413-e724-4a80-9e2b-30525e265989-istio-podinfo\") pod \"9b029413-e724-4a80-9e2b-30525e265989\" (UID: \"9b029413-e724-4a80-9e2b-30525e265989\") " Jul 21 14:58:44.441812 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:44.441486 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b029413-e724-4a80-9e2b-30525e265989-workload-socket\") pod \"9b029413-e724-4a80-9e2b-30525e265989\" (UID: \"9b029413-e724-4a80-9e2b-30525e265989\") " Jul 21 14:58:44.441812 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:44.441643 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b029413-e724-4a80-9e2b-30525e265989-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9b029413-e724-4a80-9e2b-30525e265989" (UID: "9b029413-e724-4a80-9e2b-30525e265989"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:58:44.441936 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:44.441921 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b029413-e724-4a80-9e2b-30525e265989-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9b029413-e724-4a80-9e2b-30525e265989" (UID: "9b029413-e724-4a80-9e2b-30525e265989"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 14:58:44.442000 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:44.441908 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b029413-e724-4a80-9e2b-30525e265989-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9b029413-e724-4a80-9e2b-30525e265989" (UID: "9b029413-e724-4a80-9e2b-30525e265989"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:58:44.442000 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:44.441950 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b029413-e724-4a80-9e2b-30525e265989-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9b029413-e724-4a80-9e2b-30525e265989" (UID: "9b029413-e724-4a80-9e2b-30525e265989"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:58:44.442000 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:44.441952 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b029413-e724-4a80-9e2b-30525e265989-credential-socket\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:58:44.442516 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:44.442493 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b029413-e724-4a80-9e2b-30525e265989-istio-data" (OuterVolumeSpecName: "istio-data") pod "9b029413-e724-4a80-9e2b-30525e265989" (UID: "9b029413-e724-4a80-9e2b-30525e265989"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:58:44.443569 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:44.443548 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b029413-e724-4a80-9e2b-30525e265989-kube-api-access-js52h" (OuterVolumeSpecName: "kube-api-access-js52h") pod "9b029413-e724-4a80-9e2b-30525e265989" (UID: "9b029413-e724-4a80-9e2b-30525e265989"). InnerVolumeSpecName "kube-api-access-js52h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 14:58:44.443656 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:44.443622 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b029413-e724-4a80-9e2b-30525e265989-istio-token" (OuterVolumeSpecName: "istio-token") pod "9b029413-e724-4a80-9e2b-30525e265989" (UID: "9b029413-e724-4a80-9e2b-30525e265989"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 14:58:44.443870 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:44.443846 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b029413-e724-4a80-9e2b-30525e265989-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9b029413-e724-4a80-9e2b-30525e265989" (UID: "9b029413-e724-4a80-9e2b-30525e265989"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:58:44.444068 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:44.444043 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9b029413-e724-4a80-9e2b-30525e265989-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9b029413-e724-4a80-9e2b-30525e265989" (UID: "9b029413-e724-4a80-9e2b-30525e265989"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 21 14:58:44.543375 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:44.543312 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-js52h\" (UniqueName: \"kubernetes.io/projected/9b029413-e724-4a80-9e2b-30525e265989-kube-api-access-js52h\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:58:44.543375 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:44.543370 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b029413-e724-4a80-9e2b-30525e265989-istio-data\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:58:44.543375 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:44.543383 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b029413-e724-4a80-9e2b-30525e265989-istio-token\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:58:44.543375 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:44.543391 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b029413-e724-4a80-9e2b-30525e265989-istio-podinfo\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:58:44.543673 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:44.543400 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b029413-e724-4a80-9e2b-30525e265989-workload-socket\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:58:44.543673 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:44.543410 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b029413-e724-4a80-9e2b-30525e265989-istio-envoy\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:58:44.543673 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:44.543419 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b029413-e724-4a80-9e2b-30525e265989-istiod-ca-cert\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:58:44.543673 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:44.543426 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b029413-e724-4a80-9e2b-30525e265989-workload-certs\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 14:58:44.783999 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:44.783961 2576 generic.go:356] "Generic (PLEG): container finished" podID="9b029413-e724-4a80-9e2b-30525e265989" containerID="c5d7a7236170a73646db3c06e00187a0f5272fc60724fcdfa25c89a7dc813b90" exitCode=0 Jul 21 14:58:44.784225 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:44.784041 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x" Jul 21 14:58:44.784225 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:44.784048 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x" event={"ID":"9b029413-e724-4a80-9e2b-30525e265989","Type":"ContainerDied","Data":"c5d7a7236170a73646db3c06e00187a0f5272fc60724fcdfa25c89a7dc813b90"} Jul 21 14:58:44.784225 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:44.784143 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x" event={"ID":"9b029413-e724-4a80-9e2b-30525e265989","Type":"ContainerDied","Data":"ee23aa3ae61b0467d98e8831a5b371675d072b64bbd7bb4dc2b0a66c2d75ead4"} Jul 21 14:58:44.784225 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:44.784201 2576 scope.go:117] "RemoveContainer" containerID="c5d7a7236170a73646db3c06e00187a0f5272fc60724fcdfa25c89a7dc813b90" Jul 21 14:58:44.795018 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:44.794999 2576 scope.go:117] "RemoveContainer" containerID="c31d843b951be8a009a9ab70c46aa037e4a5dc8a272fdcccbe97099772825a0a" Jul 21 14:58:44.804616 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:44.804593 2576 scope.go:117] "RemoveContainer" containerID="c5d7a7236170a73646db3c06e00187a0f5272fc60724fcdfa25c89a7dc813b90" Jul 21 14:58:44.804956 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:58:44.804932 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5d7a7236170a73646db3c06e00187a0f5272fc60724fcdfa25c89a7dc813b90\": container with ID starting with c5d7a7236170a73646db3c06e00187a0f5272fc60724fcdfa25c89a7dc813b90 not found: ID does not exist" containerID="c5d7a7236170a73646db3c06e00187a0f5272fc60724fcdfa25c89a7dc813b90" Jul 21 14:58:44.805013 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:44.804966 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5d7a7236170a73646db3c06e00187a0f5272fc60724fcdfa25c89a7dc813b90"} err="failed to get container status \"c5d7a7236170a73646db3c06e00187a0f5272fc60724fcdfa25c89a7dc813b90\": rpc error: code = NotFound desc = could not find container \"c5d7a7236170a73646db3c06e00187a0f5272fc60724fcdfa25c89a7dc813b90\": container with ID starting with c5d7a7236170a73646db3c06e00187a0f5272fc60724fcdfa25c89a7dc813b90 not found: ID does not exist" Jul 21 14:58:44.805013 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:44.804988 2576 scope.go:117] "RemoveContainer" containerID="c31d843b951be8a009a9ab70c46aa037e4a5dc8a272fdcccbe97099772825a0a" Jul 21 14:58:44.805268 ip-10-0-140-199 kubenswrapper[2576]: E0721 14:58:44.805249 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c31d843b951be8a009a9ab70c46aa037e4a5dc8a272fdcccbe97099772825a0a\": container with ID starting with c31d843b951be8a009a9ab70c46aa037e4a5dc8a272fdcccbe97099772825a0a not found: ID does not exist" containerID="c31d843b951be8a009a9ab70c46aa037e4a5dc8a272fdcccbe97099772825a0a" Jul 21 14:58:44.805337 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:44.805277 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c31d843b951be8a009a9ab70c46aa037e4a5dc8a272fdcccbe97099772825a0a"} err="failed to get container status \"c31d843b951be8a009a9ab70c46aa037e4a5dc8a272fdcccbe97099772825a0a\": rpc error: code = NotFound desc = could not find container \"c31d843b951be8a009a9ab70c46aa037e4a5dc8a272fdcccbe97099772825a0a\": container with ID starting with c31d843b951be8a009a9ab70c46aa037e4a5dc8a272fdcccbe97099772825a0a not found: ID does not exist" Jul 21 14:58:44.816843 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:44.816802 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x"] Jul 21 14:58:44.821212 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:44.821179 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-63bc89-openshift-default-75799ff54c-dbv4x"] Jul 21 14:58:45.526649 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:45.526615 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b029413-e724-4a80-9e2b-30525e265989" path="/var/lib/kubelet/pods/9b029413-e724-4a80-9e2b-30525e265989/volumes" Jul 21 14:58:47.892301 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:47.892254 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg"] Jul 21 14:58:47.892815 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:47.892666 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0daad0f6-785c-4149-bfba-7543db2d2e4f" containerName="istio-proxy" Jul 21 14:58:47.892815 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:47.892676 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0daad0f6-785c-4149-bfba-7543db2d2e4f" containerName="istio-proxy" Jul 21 14:58:47.892815 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:47.892688 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b029413-e724-4a80-9e2b-30525e265989" containerName="istio-proxy" Jul 21 14:58:47.892815 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:47.892693 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b029413-e724-4a80-9e2b-30525e265989" containerName="istio-proxy" Jul 21 14:58:47.892815 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:47.892701 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b029413-e724-4a80-9e2b-30525e265989" containerName="istio-proxy" Jul 21 14:58:47.892815 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:47.892706 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b029413-e724-4a80-9e2b-30525e265989" containerName="istio-proxy" Jul 21 14:58:47.892815 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:47.892791 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b029413-e724-4a80-9e2b-30525e265989" containerName="istio-proxy" Jul 21 14:58:47.892815 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:47.892807 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b029413-e724-4a80-9e2b-30525e265989" containerName="istio-proxy" Jul 21 14:58:47.897455 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:47.897434 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg" Jul 21 14:58:47.901208 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:47.901180 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-449411-openshift-default-dockercfg-lr7dm\"" Jul 21 14:58:47.910968 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:47.910935 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg"] Jul 21 14:58:47.977961 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:47.977913 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38ee1ea3-9f80-4acc-983c-317a12c9cc40-workload-certs\") pod \"e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg\" (UID: \"38ee1ea3-9f80-4acc-983c-317a12c9cc40\") " pod="openshift-ingress/e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg" Jul 21 14:58:47.978389 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:47.978349 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38ee1ea3-9f80-4acc-983c-317a12c9cc40-istio-data\") pod \"e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg\" (UID: \"38ee1ea3-9f80-4acc-983c-317a12c9cc40\") " pod="openshift-ingress/e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg" Jul 21 14:58:47.978642 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:47.978610 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38ee1ea3-9f80-4acc-983c-317a12c9cc40-credential-socket\") pod \"e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg\" (UID: \"38ee1ea3-9f80-4acc-983c-317a12c9cc40\") " pod="openshift-ingress/e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg" Jul 21 14:58:47.978805 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:47.978726 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38ee1ea3-9f80-4acc-983c-317a12c9cc40-workload-socket\") pod \"e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg\" (UID: \"38ee1ea3-9f80-4acc-983c-317a12c9cc40\") " pod="openshift-ingress/e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg" Jul 21 14:58:47.978921 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:47.978810 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38ee1ea3-9f80-4acc-983c-317a12c9cc40-istio-envoy\") pod \"e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg\" (UID: \"38ee1ea3-9f80-4acc-983c-317a12c9cc40\") " pod="openshift-ingress/e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg" Jul 21 14:58:47.978921 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:47.978845 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phdzp\" (UniqueName: \"kubernetes.io/projected/38ee1ea3-9f80-4acc-983c-317a12c9cc40-kube-api-access-phdzp\") pod \"e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg\" (UID: \"38ee1ea3-9f80-4acc-983c-317a12c9cc40\") " pod="openshift-ingress/e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg" Jul 21 14:58:47.978921 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:47.978901 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38ee1ea3-9f80-4acc-983c-317a12c9cc40-istio-token\") pod \"e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg\" (UID: \"38ee1ea3-9f80-4acc-983c-317a12c9cc40\") " pod="openshift-ingress/e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg" Jul 21 14:58:47.979061 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:47.979028 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38ee1ea3-9f80-4acc-983c-317a12c9cc40-istio-podinfo\") pod \"e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg\" (UID: \"38ee1ea3-9f80-4acc-983c-317a12c9cc40\") " pod="openshift-ingress/e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg" Jul 21 14:58:47.979099 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:47.979067 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38ee1ea3-9f80-4acc-983c-317a12c9cc40-istiod-ca-cert\") pod \"e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg\" (UID: \"38ee1ea3-9f80-4acc-983c-317a12c9cc40\") " pod="openshift-ingress/e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg" Jul 21 14:58:48.080118 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:48.080074 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38ee1ea3-9f80-4acc-983c-317a12c9cc40-istio-podinfo\") pod \"e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg\" (UID: \"38ee1ea3-9f80-4acc-983c-317a12c9cc40\") " pod="openshift-ingress/e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg" Jul 21 14:58:48.080118 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:48.080120 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38ee1ea3-9f80-4acc-983c-317a12c9cc40-istiod-ca-cert\") pod \"e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg\" (UID: \"38ee1ea3-9f80-4acc-983c-317a12c9cc40\") " pod="openshift-ingress/e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg" Jul 21 14:58:48.080408 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:48.080253 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38ee1ea3-9f80-4acc-983c-317a12c9cc40-workload-certs\") pod \"e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg\" (UID: \"38ee1ea3-9f80-4acc-983c-317a12c9cc40\") " pod="openshift-ingress/e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg" Jul 21 14:58:48.080408 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:48.080321 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38ee1ea3-9f80-4acc-983c-317a12c9cc40-istio-data\") pod \"e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg\" (UID: \"38ee1ea3-9f80-4acc-983c-317a12c9cc40\") " pod="openshift-ingress/e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg" Jul 21 14:58:48.080408 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:48.080360 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38ee1ea3-9f80-4acc-983c-317a12c9cc40-credential-socket\") pod \"e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg\" (UID: \"38ee1ea3-9f80-4acc-983c-317a12c9cc40\") " pod="openshift-ingress/e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg" Jul 21 14:58:48.080583 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:48.080439 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38ee1ea3-9f80-4acc-983c-317a12c9cc40-workload-socket\") pod \"e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg\" (UID: \"38ee1ea3-9f80-4acc-983c-317a12c9cc40\") " pod="openshift-ingress/e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg" Jul 21 14:58:48.080583 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:48.080478 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38ee1ea3-9f80-4acc-983c-317a12c9cc40-istio-envoy\") pod \"e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg\" (UID: \"38ee1ea3-9f80-4acc-983c-317a12c9cc40\") " pod="openshift-ingress/e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg" Jul 21 14:58:48.080583 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:48.080507 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phdzp\" (UniqueName: \"kubernetes.io/projected/38ee1ea3-9f80-4acc-983c-317a12c9cc40-kube-api-access-phdzp\") pod \"e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg\" (UID: \"38ee1ea3-9f80-4acc-983c-317a12c9cc40\") " pod="openshift-ingress/e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg" Jul 21 14:58:48.080583 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:48.080542 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38ee1ea3-9f80-4acc-983c-317a12c9cc40-istio-token\") pod \"e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg\" (UID: \"38ee1ea3-9f80-4acc-983c-317a12c9cc40\") " pod="openshift-ingress/e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg" Jul 21 14:58:48.080845 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:48.080657 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38ee1ea3-9f80-4acc-983c-317a12c9cc40-workload-certs\") pod \"e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg\" (UID: \"38ee1ea3-9f80-4acc-983c-317a12c9cc40\") " pod="openshift-ingress/e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg" Jul 21 14:58:48.080845 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:48.080718 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38ee1ea3-9f80-4acc-983c-317a12c9cc40-istio-data\") pod \"e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg\" (UID: \"38ee1ea3-9f80-4acc-983c-317a12c9cc40\") " pod="openshift-ingress/e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg" Jul 21 14:58:48.080964 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:48.080896 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38ee1ea3-9f80-4acc-983c-317a12c9cc40-workload-socket\") pod \"e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg\" (UID: \"38ee1ea3-9f80-4acc-983c-317a12c9cc40\") " pod="openshift-ingress/e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg" Jul 21 14:58:48.080964 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:48.080939 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38ee1ea3-9f80-4acc-983c-317a12c9cc40-credential-socket\") pod \"e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg\" (UID: \"38ee1ea3-9f80-4acc-983c-317a12c9cc40\") " pod="openshift-ingress/e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg" Jul 21 14:58:48.081059 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:48.080973 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38ee1ea3-9f80-4acc-983c-317a12c9cc40-istiod-ca-cert\") pod \"e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg\" (UID: \"38ee1ea3-9f80-4acc-983c-317a12c9cc40\") " pod="openshift-ingress/e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg" Jul 21 14:58:48.082865 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:48.082845 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38ee1ea3-9f80-4acc-983c-317a12c9cc40-istio-podinfo\") pod \"e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg\" (UID: \"38ee1ea3-9f80-4acc-983c-317a12c9cc40\") " pod="openshift-ingress/e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg" Jul 21 14:58:48.082954 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:48.082876 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38ee1ea3-9f80-4acc-983c-317a12c9cc40-istio-envoy\") pod \"e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg\" (UID: \"38ee1ea3-9f80-4acc-983c-317a12c9cc40\") " pod="openshift-ingress/e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg" Jul 21 14:58:48.092036 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:48.092005 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38ee1ea3-9f80-4acc-983c-317a12c9cc40-istio-token\") pod \"e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg\" (UID: \"38ee1ea3-9f80-4acc-983c-317a12c9cc40\") " pod="openshift-ingress/e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg" Jul 21 14:58:48.092163 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:48.092075 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-phdzp\" (UniqueName: \"kubernetes.io/projected/38ee1ea3-9f80-4acc-983c-317a12c9cc40-kube-api-access-phdzp\") pod \"e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg\" (UID: \"38ee1ea3-9f80-4acc-983c-317a12c9cc40\") " pod="openshift-ingress/e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg" Jul 21 14:58:48.209201 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:48.209103 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg" Jul 21 14:58:48.372773 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:48.372742 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg"] Jul 21 14:58:48.373681 ip-10-0-140-199 kubenswrapper[2576]: W0721 14:58:48.373657 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38ee1ea3_9f80_4acc_983c_317a12c9cc40.slice/crio-1f0ed753582956c6005e55afaea4831c60f452b6f226f91a46e9ff22c249d889 WatchSource:0}: Error finding container 1f0ed753582956c6005e55afaea4831c60f452b6f226f91a46e9ff22c249d889: Status 404 returned error can't find the container with id 1f0ed753582956c6005e55afaea4831c60f452b6f226f91a46e9ff22c249d889 Jul 21 14:58:48.375833 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:48.375801 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:58:48.375887 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:48.375873 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:58:48.375925 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:48.375902 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:58:48.811089 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:48.811041 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg" event={"ID":"38ee1ea3-9f80-4acc-983c-317a12c9cc40","Type":"ContainerStarted","Data":"4b284ac6c381493aada9f905ce87bea16dbfc4bc236abf4cd71e94e494c16c78"} Jul 21 14:58:48.811274 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:48.811122 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg" event={"ID":"38ee1ea3-9f80-4acc-983c-317a12c9cc40","Type":"ContainerStarted","Data":"1f0ed753582956c6005e55afaea4831c60f452b6f226f91a46e9ff22c249d889"} Jul 21 14:58:48.851483 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:48.851419 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg" podStartSLOduration=1.8513990759999999 podStartE2EDuration="1.851399076s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:58:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:58:48.849436591 +0000 UTC m=+2455.867340165" watchObservedRunningTime="2026-07-21 14:58:48.851399076 +0000 UTC m=+2455.869302734" Jul 21 14:58:49.210040 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:49.209933 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg" Jul 21 14:58:49.215306 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:49.215271 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg" Jul 21 14:58:49.821624 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:49.821584 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg" Jul 21 14:58:49.822895 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:49.822863 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg" Jul 21 14:58:56.767705 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:56.767655 2576 patch_prober.go:28] interesting pod/e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body= Jul 21 14:58:56.768198 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:56.767729 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj" podUID="b4aa1c92-4af0-4b8b-a7b8-d322c4904370" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" Jul 21 14:58:56.865720 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:56.865685 2576 generic.go:356] "Generic (PLEG): container finished" podID="b4aa1c92-4af0-4b8b-a7b8-d322c4904370" containerID="7c0e811bb7b1fca55c70d4749fc9aab00b71ce12f348383049ad53964f08d2c4" exitCode=0 Jul 21 14:58:56.865912 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:56.865758 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj" event={"ID":"b4aa1c92-4af0-4b8b-a7b8-d322c4904370","Type":"ContainerDied","Data":"7c0e811bb7b1fca55c70d4749fc9aab00b71ce12f348383049ad53964f08d2c4"} Jul 21 14:58:56.866245 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:56.866231 2576 scope.go:117] "RemoveContainer" containerID="7c0e811bb7b1fca55c70d4749fc9aab00b71ce12f348383049ad53964f08d2c4" Jul 21 14:58:56.867431 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:56.867398 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:58:56.867497 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:56.867484 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:58:56.867541 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:56.867523 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:58:57.873235 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:57.873201 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj" event={"ID":"b4aa1c92-4af0-4b8b-a7b8-d322c4904370","Type":"ContainerStarted","Data":"4389357980abb50809f8cda07f1ffd6940ed093648e65364a479c68590b30599"} Jul 21 14:58:58.370540 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:58.370503 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj" Jul 21 14:58:58.370914 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:58.370894 2576 patch_prober.go:28] interesting pod/e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body= Jul 21 14:58:58.371006 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:58.370942 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj" podUID="b4aa1c92-4af0-4b8b-a7b8-d322c4904370" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" Jul 21 14:58:59.371209 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:59.371165 2576 patch_prober.go:28] interesting pod/e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body= Jul 21 14:58:59.371625 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:58:59.371244 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj" podUID="b4aa1c92-4af0-4b8b-a7b8-d322c4904370" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" Jul 21 14:59:00.371643 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:59:00.371601 2576 patch_prober.go:28] interesting pod/e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body= Jul 21 14:59:00.372104 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:59:00.371661 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj" podUID="b4aa1c92-4af0-4b8b-a7b8-d322c4904370" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" Jul 21 14:59:01.370836 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:59:01.370768 2576 patch_prober.go:28] interesting pod/e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body= Jul 21 14:59:01.371065 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:59:01.370863 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj" podUID="b4aa1c92-4af0-4b8b-a7b8-d322c4904370" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" Jul 21 14:59:02.375079 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:59:02.375047 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj" Jul 21 14:59:02.375493 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:59:02.375350 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj" Jul 21 14:59:02.376292 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:59:02.376275 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj" Jul 21 14:59:07.944931 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:59:07.944891 2576 generic.go:356] "Generic (PLEG): container finished" podID="38ee1ea3-9f80-4acc-983c-317a12c9cc40" containerID="4b284ac6c381493aada9f905ce87bea16dbfc4bc236abf4cd71e94e494c16c78" exitCode=0 Jul 21 14:59:07.945340 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:59:07.944955 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg" event={"ID":"38ee1ea3-9f80-4acc-983c-317a12c9cc40","Type":"ContainerDied","Data":"4b284ac6c381493aada9f905ce87bea16dbfc4bc236abf4cd71e94e494c16c78"} Jul 21 14:59:07.945425 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:59:07.945409 2576 scope.go:117] "RemoveContainer" containerID="4b284ac6c381493aada9f905ce87bea16dbfc4bc236abf4cd71e94e494c16c78" Jul 21 14:59:07.946593 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:59:07.946565 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:59:07.946678 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:59:07.946661 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:59:07.946716 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:59:07.946706 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 21 14:59:08.952997 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:59:08.952960 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg" event={"ID":"38ee1ea3-9f80-4acc-983c-317a12c9cc40","Type":"ContainerStarted","Data":"e86e0c5753a7edcf063bd16294a3319062e378b97d462a855d5b1dc378763576"} Jul 21 14:59:09.210373 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:59:09.210268 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg" Jul 21 14:59:09.210747 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:59:09.210724 2576 patch_prober.go:28] interesting pod/e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body= Jul 21 14:59:09.210947 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:59:09.210916 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg" podUID="38ee1ea3-9f80-4acc-983c-317a12c9cc40" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" Jul 21 14:59:10.210628 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:59:10.210575 2576 patch_prober.go:28] interesting pod/e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body= Jul 21 14:59:10.211431 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:59:10.211393 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg" podUID="38ee1ea3-9f80-4acc-983c-317a12c9cc40" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" Jul 21 14:59:11.210326 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:59:11.210284 2576 patch_prober.go:28] interesting pod/e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body= Jul 21 14:59:11.211099 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:59:11.210630 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg" podUID="38ee1ea3-9f80-4acc-983c-317a12c9cc40" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" Jul 21 14:59:12.210309 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:59:12.210264 2576 patch_prober.go:28] interesting pod/e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body= Jul 21 14:59:12.210625 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:59:12.210595 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg" podUID="38ee1ea3-9f80-4acc-983c-317a12c9cc40" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" Jul 21 14:59:13.213930 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:59:13.213892 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg" Jul 21 14:59:13.214403 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:59:13.214266 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg" Jul 21 14:59:13.215185 ip-10-0-140-199 kubenswrapper[2576]: I0721 14:59:13.215162 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg" Jul 21 15:05:10.346161 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:10.346127 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj"] Jul 21 15:05:10.346603 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:10.346403 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj" podUID="b4aa1c92-4af0-4b8b-a7b8-d322c4904370" containerName="istio-proxy" containerID="cri-o://4389357980abb50809f8cda07f1ffd6940ed093648e65364a479c68590b30599" gracePeriod=30 Jul 21 15:05:15.614213 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:15.614140 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj" Jul 21 15:05:15.665497 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:15.665463 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-678s6\" (UniqueName: \"kubernetes.io/projected/b4aa1c92-4af0-4b8b-a7b8-d322c4904370-kube-api-access-678s6\") pod \"b4aa1c92-4af0-4b8b-a7b8-d322c4904370\" (UID: \"b4aa1c92-4af0-4b8b-a7b8-d322c4904370\") " Jul 21 15:05:15.666020 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:15.665508 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4aa1c92-4af0-4b8b-a7b8-d322c4904370-istiod-ca-cert\") pod \"b4aa1c92-4af0-4b8b-a7b8-d322c4904370\" (UID: \"b4aa1c92-4af0-4b8b-a7b8-d322c4904370\") " Jul 21 15:05:15.666020 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:15.665527 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4aa1c92-4af0-4b8b-a7b8-d322c4904370-credential-socket\") pod \"b4aa1c92-4af0-4b8b-a7b8-d322c4904370\" (UID: \"b4aa1c92-4af0-4b8b-a7b8-d322c4904370\") " Jul 21 15:05:15.666020 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:15.665563 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4aa1c92-4af0-4b8b-a7b8-d322c4904370-istio-data\") pod \"b4aa1c92-4af0-4b8b-a7b8-d322c4904370\" (UID: \"b4aa1c92-4af0-4b8b-a7b8-d322c4904370\") " Jul 21 15:05:15.666020 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:15.665582 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4aa1c92-4af0-4b8b-a7b8-d322c4904370-istio-podinfo\") pod \"b4aa1c92-4af0-4b8b-a7b8-d322c4904370\" (UID: \"b4aa1c92-4af0-4b8b-a7b8-d322c4904370\") " Jul 21 15:05:15.666020 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:15.665613 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4aa1c92-4af0-4b8b-a7b8-d322c4904370-workload-socket\") pod \"b4aa1c92-4af0-4b8b-a7b8-d322c4904370\" (UID: \"b4aa1c92-4af0-4b8b-a7b8-d322c4904370\") " Jul 21 15:05:15.666020 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:15.665644 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4aa1c92-4af0-4b8b-a7b8-d322c4904370-workload-certs\") pod \"b4aa1c92-4af0-4b8b-a7b8-d322c4904370\" (UID: \"b4aa1c92-4af0-4b8b-a7b8-d322c4904370\") " Jul 21 15:05:15.666020 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:15.665717 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4aa1c92-4af0-4b8b-a7b8-d322c4904370-istio-token\") pod \"b4aa1c92-4af0-4b8b-a7b8-d322c4904370\" (UID: \"b4aa1c92-4af0-4b8b-a7b8-d322c4904370\") " Jul 21 15:05:15.666020 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:15.665804 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4aa1c92-4af0-4b8b-a7b8-d322c4904370-istio-envoy\") pod \"b4aa1c92-4af0-4b8b-a7b8-d322c4904370\" (UID: \"b4aa1c92-4af0-4b8b-a7b8-d322c4904370\") " Jul 21 15:05:15.666020 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:15.665960 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4aa1c92-4af0-4b8b-a7b8-d322c4904370-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b4aa1c92-4af0-4b8b-a7b8-d322c4904370" (UID: "b4aa1c92-4af0-4b8b-a7b8-d322c4904370"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 15:05:15.666020 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:15.665989 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4aa1c92-4af0-4b8b-a7b8-d322c4904370-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b4aa1c92-4af0-4b8b-a7b8-d322c4904370" (UID: "b4aa1c92-4af0-4b8b-a7b8-d322c4904370"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 15:05:15.666476 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:15.666163 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4aa1c92-4af0-4b8b-a7b8-d322c4904370-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b4aa1c92-4af0-4b8b-a7b8-d322c4904370" (UID: "b4aa1c92-4af0-4b8b-a7b8-d322c4904370"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 15:05:15.666476 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:15.666252 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4aa1c92-4af0-4b8b-a7b8-d322c4904370-istiod-ca-cert\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 15:05:15.666476 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:15.666273 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4aa1c92-4af0-4b8b-a7b8-d322c4904370-credential-socket\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 15:05:15.666476 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:15.666365 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4aa1c92-4af0-4b8b-a7b8-d322c4904370-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b4aa1c92-4af0-4b8b-a7b8-d322c4904370" (UID: "b4aa1c92-4af0-4b8b-a7b8-d322c4904370"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 15:05:15.666476 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:15.666467 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4aa1c92-4af0-4b8b-a7b8-d322c4904370-istio-data" (OuterVolumeSpecName: "istio-data") pod "b4aa1c92-4af0-4b8b-a7b8-d322c4904370" (UID: "b4aa1c92-4af0-4b8b-a7b8-d322c4904370"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 15:05:15.668204 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:15.668172 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4aa1c92-4af0-4b8b-a7b8-d322c4904370-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b4aa1c92-4af0-4b8b-a7b8-d322c4904370" (UID: "b4aa1c92-4af0-4b8b-a7b8-d322c4904370"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 15:05:15.668321 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:15.668241 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b4aa1c92-4af0-4b8b-a7b8-d322c4904370-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b4aa1c92-4af0-4b8b-a7b8-d322c4904370" (UID: "b4aa1c92-4af0-4b8b-a7b8-d322c4904370"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 21 15:05:15.668321 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:15.668255 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4aa1c92-4af0-4b8b-a7b8-d322c4904370-kube-api-access-678s6" (OuterVolumeSpecName: "kube-api-access-678s6") pod "b4aa1c92-4af0-4b8b-a7b8-d322c4904370" (UID: "b4aa1c92-4af0-4b8b-a7b8-d322c4904370"). InnerVolumeSpecName "kube-api-access-678s6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 15:05:15.668578 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:15.668557 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4aa1c92-4af0-4b8b-a7b8-d322c4904370-istio-token" (OuterVolumeSpecName: "istio-token") pod "b4aa1c92-4af0-4b8b-a7b8-d322c4904370" (UID: "b4aa1c92-4af0-4b8b-a7b8-d322c4904370"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 15:05:15.767317 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:15.767280 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4aa1c92-4af0-4b8b-a7b8-d322c4904370-istio-envoy\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 15:05:15.767317 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:15.767312 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-678s6\" (UniqueName: \"kubernetes.io/projected/b4aa1c92-4af0-4b8b-a7b8-d322c4904370-kube-api-access-678s6\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 15:05:15.767317 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:15.767321 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4aa1c92-4af0-4b8b-a7b8-d322c4904370-istio-data\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 15:05:15.767317 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:15.767331 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4aa1c92-4af0-4b8b-a7b8-d322c4904370-istio-podinfo\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 15:05:15.767595 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:15.767341 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4aa1c92-4af0-4b8b-a7b8-d322c4904370-workload-socket\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 15:05:15.767595 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:15.767350 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4aa1c92-4af0-4b8b-a7b8-d322c4904370-workload-certs\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 15:05:15.767595 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:15.767359 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4aa1c92-4af0-4b8b-a7b8-d322c4904370-istio-token\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 15:05:15.988053 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:15.988016 2576 generic.go:356] "Generic (PLEG): container finished" podID="b4aa1c92-4af0-4b8b-a7b8-d322c4904370" containerID="4389357980abb50809f8cda07f1ffd6940ed093648e65364a479c68590b30599" exitCode=0 Jul 21 15:05:15.988257 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:15.988076 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj" event={"ID":"b4aa1c92-4af0-4b8b-a7b8-d322c4904370","Type":"ContainerDied","Data":"4389357980abb50809f8cda07f1ffd6940ed093648e65364a479c68590b30599"} Jul 21 15:05:15.988257 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:15.988082 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj" Jul 21 15:05:15.988257 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:15.988163 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj" event={"ID":"b4aa1c92-4af0-4b8b-a7b8-d322c4904370","Type":"ContainerDied","Data":"947a2005335848d24efc5126087d45c169fc23a957d62c2bc0946d3e8cb728e5"} Jul 21 15:05:15.988257 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:15.988195 2576 scope.go:117] "RemoveContainer" containerID="4389357980abb50809f8cda07f1ffd6940ed093648e65364a479c68590b30599" Jul 21 15:05:15.998160 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:15.998142 2576 scope.go:117] "RemoveContainer" containerID="7c0e811bb7b1fca55c70d4749fc9aab00b71ce12f348383049ad53964f08d2c4" Jul 21 15:05:16.007802 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:16.007766 2576 scope.go:117] "RemoveContainer" containerID="4389357980abb50809f8cda07f1ffd6940ed093648e65364a479c68590b30599" Jul 21 15:05:16.008092 ip-10-0-140-199 kubenswrapper[2576]: E0721 15:05:16.008073 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4389357980abb50809f8cda07f1ffd6940ed093648e65364a479c68590b30599\": container with ID starting with 4389357980abb50809f8cda07f1ffd6940ed093648e65364a479c68590b30599 not found: ID does not exist" containerID="4389357980abb50809f8cda07f1ffd6940ed093648e65364a479c68590b30599" Jul 21 15:05:16.008174 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:16.008102 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4389357980abb50809f8cda07f1ffd6940ed093648e65364a479c68590b30599"} err="failed to get container status \"4389357980abb50809f8cda07f1ffd6940ed093648e65364a479c68590b30599\": rpc error: code = NotFound desc = could not find container \"4389357980abb50809f8cda07f1ffd6940ed093648e65364a479c68590b30599\": container with ID starting with 4389357980abb50809f8cda07f1ffd6940ed093648e65364a479c68590b30599 not found: ID does not exist" Jul 21 15:05:16.008174 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:16.008122 2576 scope.go:117] "RemoveContainer" containerID="7c0e811bb7b1fca55c70d4749fc9aab00b71ce12f348383049ad53964f08d2c4" Jul 21 15:05:16.008402 ip-10-0-140-199 kubenswrapper[2576]: E0721 15:05:16.008380 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c0e811bb7b1fca55c70d4749fc9aab00b71ce12f348383049ad53964f08d2c4\": container with ID starting with 7c0e811bb7b1fca55c70d4749fc9aab00b71ce12f348383049ad53964f08d2c4 not found: ID does not exist" containerID="7c0e811bb7b1fca55c70d4749fc9aab00b71ce12f348383049ad53964f08d2c4" Jul 21 15:05:16.008500 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:16.008410 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c0e811bb7b1fca55c70d4749fc9aab00b71ce12f348383049ad53964f08d2c4"} err="failed to get container status \"7c0e811bb7b1fca55c70d4749fc9aab00b71ce12f348383049ad53964f08d2c4\": rpc error: code = NotFound desc = could not find container \"7c0e811bb7b1fca55c70d4749fc9aab00b71ce12f348383049ad53964f08d2c4\": container with ID starting with 7c0e811bb7b1fca55c70d4749fc9aab00b71ce12f348383049ad53964f08d2c4 not found: ID does not exist" Jul 21 15:05:16.017553 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:16.017523 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj"] Jul 21 15:05:16.023948 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:16.023917 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-d89949-openshift-default-6f8b5689bc-2rfmj"] Jul 21 15:05:17.525984 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:17.525940 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4aa1c92-4af0-4b8b-a7b8-d322c4904370" path="/var/lib/kubelet/pods/b4aa1c92-4af0-4b8b-a7b8-d322c4904370/volumes" Jul 21 15:05:34.110846 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:34.110809 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg"] Jul 21 15:05:34.111392 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:34.111077 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg" podUID="38ee1ea3-9f80-4acc-983c-317a12c9cc40" containerName="istio-proxy" containerID="cri-o://e86e0c5753a7edcf063bd16294a3319062e378b97d462a855d5b1dc378763576" gracePeriod=30 Jul 21 15:05:39.377485 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:39.377397 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg" Jul 21 15:05:39.502374 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:39.502337 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38ee1ea3-9f80-4acc-983c-317a12c9cc40-istio-data\") pod \"38ee1ea3-9f80-4acc-983c-317a12c9cc40\" (UID: \"38ee1ea3-9f80-4acc-983c-317a12c9cc40\") " Jul 21 15:05:39.502580 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:39.502400 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38ee1ea3-9f80-4acc-983c-317a12c9cc40-istio-podinfo\") pod \"38ee1ea3-9f80-4acc-983c-317a12c9cc40\" (UID: \"38ee1ea3-9f80-4acc-983c-317a12c9cc40\") " Jul 21 15:05:39.502580 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:39.502437 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38ee1ea3-9f80-4acc-983c-317a12c9cc40-workload-certs\") pod \"38ee1ea3-9f80-4acc-983c-317a12c9cc40\" (UID: \"38ee1ea3-9f80-4acc-983c-317a12c9cc40\") " Jul 21 15:05:39.502580 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:39.502487 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38ee1ea3-9f80-4acc-983c-317a12c9cc40-credential-socket\") pod \"38ee1ea3-9f80-4acc-983c-317a12c9cc40\" (UID: \"38ee1ea3-9f80-4acc-983c-317a12c9cc40\") " Jul 21 15:05:39.502580 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:39.502513 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38ee1ea3-9f80-4acc-983c-317a12c9cc40-istio-envoy\") pod \"38ee1ea3-9f80-4acc-983c-317a12c9cc40\" (UID: \"38ee1ea3-9f80-4acc-983c-317a12c9cc40\") " Jul 21 15:05:39.502829 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:39.502584 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38ee1ea3-9f80-4acc-983c-317a12c9cc40-istio-token\") pod \"38ee1ea3-9f80-4acc-983c-317a12c9cc40\" (UID: \"38ee1ea3-9f80-4acc-983c-317a12c9cc40\") " Jul 21 15:05:39.502829 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:39.502633 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-phdzp\" (UniqueName: \"kubernetes.io/projected/38ee1ea3-9f80-4acc-983c-317a12c9cc40-kube-api-access-phdzp\") pod \"38ee1ea3-9f80-4acc-983c-317a12c9cc40\" (UID: \"38ee1ea3-9f80-4acc-983c-317a12c9cc40\") " Jul 21 15:05:39.502829 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:39.502671 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38ee1ea3-9f80-4acc-983c-317a12c9cc40-istiod-ca-cert\") pod \"38ee1ea3-9f80-4acc-983c-317a12c9cc40\" (UID: \"38ee1ea3-9f80-4acc-983c-317a12c9cc40\") " Jul 21 15:05:39.502829 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:39.502714 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38ee1ea3-9f80-4acc-983c-317a12c9cc40-workload-socket\") pod \"38ee1ea3-9f80-4acc-983c-317a12c9cc40\" (UID: \"38ee1ea3-9f80-4acc-983c-317a12c9cc40\") " Jul 21 15:05:39.502829 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:39.502772 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38ee1ea3-9f80-4acc-983c-317a12c9cc40-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "38ee1ea3-9f80-4acc-983c-317a12c9cc40" (UID: "38ee1ea3-9f80-4acc-983c-317a12c9cc40"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 15:05:39.502829 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:39.502814 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38ee1ea3-9f80-4acc-983c-317a12c9cc40-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "38ee1ea3-9f80-4acc-983c-317a12c9cc40" (UID: "38ee1ea3-9f80-4acc-983c-317a12c9cc40"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 15:05:39.503130 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:39.503102 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38ee1ea3-9f80-4acc-983c-317a12c9cc40-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "38ee1ea3-9f80-4acc-983c-317a12c9cc40" (UID: "38ee1ea3-9f80-4acc-983c-317a12c9cc40"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 15:05:39.503130 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:39.503114 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38ee1ea3-9f80-4acc-983c-317a12c9cc40-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "38ee1ea3-9f80-4acc-983c-317a12c9cc40" (UID: "38ee1ea3-9f80-4acc-983c-317a12c9cc40"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 15:05:39.503247 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:39.503162 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38ee1ea3-9f80-4acc-983c-317a12c9cc40-workload-certs\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 15:05:39.503247 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:39.503177 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38ee1ea3-9f80-4acc-983c-317a12c9cc40-credential-socket\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 15:05:39.503357 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:39.503323 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38ee1ea3-9f80-4acc-983c-317a12c9cc40-istio-data" (OuterVolumeSpecName: "istio-data") pod "38ee1ea3-9f80-4acc-983c-317a12c9cc40" (UID: "38ee1ea3-9f80-4acc-983c-317a12c9cc40"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 15:05:39.504726 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:39.504699 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/38ee1ea3-9f80-4acc-983c-317a12c9cc40-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "38ee1ea3-9f80-4acc-983c-317a12c9cc40" (UID: "38ee1ea3-9f80-4acc-983c-317a12c9cc40"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 21 15:05:39.504858 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:39.504755 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38ee1ea3-9f80-4acc-983c-317a12c9cc40-istio-token" (OuterVolumeSpecName: "istio-token") pod "38ee1ea3-9f80-4acc-983c-317a12c9cc40" (UID: "38ee1ea3-9f80-4acc-983c-317a12c9cc40"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 15:05:39.504954 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:39.504929 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38ee1ea3-9f80-4acc-983c-317a12c9cc40-kube-api-access-phdzp" (OuterVolumeSpecName: "kube-api-access-phdzp") pod "38ee1ea3-9f80-4acc-983c-317a12c9cc40" (UID: "38ee1ea3-9f80-4acc-983c-317a12c9cc40"). InnerVolumeSpecName "kube-api-access-phdzp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 15:05:39.505018 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:39.504997 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38ee1ea3-9f80-4acc-983c-317a12c9cc40-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "38ee1ea3-9f80-4acc-983c-317a12c9cc40" (UID: "38ee1ea3-9f80-4acc-983c-317a12c9cc40"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 15:05:39.604460 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:39.604417 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38ee1ea3-9f80-4acc-983c-317a12c9cc40-istio-data\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 15:05:39.604460 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:39.604453 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38ee1ea3-9f80-4acc-983c-317a12c9cc40-istio-podinfo\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 15:05:39.604460 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:39.604464 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38ee1ea3-9f80-4acc-983c-317a12c9cc40-istio-envoy\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 15:05:39.604460 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:39.604472 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38ee1ea3-9f80-4acc-983c-317a12c9cc40-istio-token\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 15:05:39.604846 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:39.604481 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-phdzp\" (UniqueName: \"kubernetes.io/projected/38ee1ea3-9f80-4acc-983c-317a12c9cc40-kube-api-access-phdzp\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 15:05:39.604846 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:39.604491 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38ee1ea3-9f80-4acc-983c-317a12c9cc40-istiod-ca-cert\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 15:05:39.604846 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:39.604500 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38ee1ea3-9f80-4acc-983c-317a12c9cc40-workload-socket\") on node \"ip-10-0-140-199.ec2.internal\" DevicePath \"\"" Jul 21 15:05:40.136212 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:40.136175 2576 generic.go:356] "Generic (PLEG): container finished" podID="38ee1ea3-9f80-4acc-983c-317a12c9cc40" containerID="e86e0c5753a7edcf063bd16294a3319062e378b97d462a855d5b1dc378763576" exitCode=0 Jul 21 15:05:40.136426 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:40.136230 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg" Jul 21 15:05:40.136426 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:40.136255 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg" event={"ID":"38ee1ea3-9f80-4acc-983c-317a12c9cc40","Type":"ContainerDied","Data":"e86e0c5753a7edcf063bd16294a3319062e378b97d462a855d5b1dc378763576"} Jul 21 15:05:40.136426 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:40.136309 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg" event={"ID":"38ee1ea3-9f80-4acc-983c-317a12c9cc40","Type":"ContainerDied","Data":"1f0ed753582956c6005e55afaea4831c60f452b6f226f91a46e9ff22c249d889"} Jul 21 15:05:40.136426 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:40.136331 2576 scope.go:117] "RemoveContainer" containerID="e86e0c5753a7edcf063bd16294a3319062e378b97d462a855d5b1dc378763576" Jul 21 15:05:40.145868 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:40.145847 2576 scope.go:117] "RemoveContainer" containerID="4b284ac6c381493aada9f905ce87bea16dbfc4bc236abf4cd71e94e494c16c78" Jul 21 15:05:40.155317 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:40.155293 2576 scope.go:117] "RemoveContainer" containerID="e86e0c5753a7edcf063bd16294a3319062e378b97d462a855d5b1dc378763576" Jul 21 15:05:40.155624 ip-10-0-140-199 kubenswrapper[2576]: E0721 15:05:40.155605 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e86e0c5753a7edcf063bd16294a3319062e378b97d462a855d5b1dc378763576\": container with ID starting with e86e0c5753a7edcf063bd16294a3319062e378b97d462a855d5b1dc378763576 not found: ID does not exist" containerID="e86e0c5753a7edcf063bd16294a3319062e378b97d462a855d5b1dc378763576" Jul 21 15:05:40.155671 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:40.155637 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e86e0c5753a7edcf063bd16294a3319062e378b97d462a855d5b1dc378763576"} err="failed to get container status \"e86e0c5753a7edcf063bd16294a3319062e378b97d462a855d5b1dc378763576\": rpc error: code = NotFound desc = could not find container \"e86e0c5753a7edcf063bd16294a3319062e378b97d462a855d5b1dc378763576\": container with ID starting with e86e0c5753a7edcf063bd16294a3319062e378b97d462a855d5b1dc378763576 not found: ID does not exist" Jul 21 15:05:40.155671 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:40.155658 2576 scope.go:117] "RemoveContainer" containerID="4b284ac6c381493aada9f905ce87bea16dbfc4bc236abf4cd71e94e494c16c78" Jul 21 15:05:40.155913 ip-10-0-140-199 kubenswrapper[2576]: E0721 15:05:40.155896 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b284ac6c381493aada9f905ce87bea16dbfc4bc236abf4cd71e94e494c16c78\": container with ID starting with 4b284ac6c381493aada9f905ce87bea16dbfc4bc236abf4cd71e94e494c16c78 not found: ID does not exist" containerID="4b284ac6c381493aada9f905ce87bea16dbfc4bc236abf4cd71e94e494c16c78" Jul 21 15:05:40.155963 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:40.155918 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b284ac6c381493aada9f905ce87bea16dbfc4bc236abf4cd71e94e494c16c78"} err="failed to get container status \"4b284ac6c381493aada9f905ce87bea16dbfc4bc236abf4cd71e94e494c16c78\": rpc error: code = NotFound desc = could not find container \"4b284ac6c381493aada9f905ce87bea16dbfc4bc236abf4cd71e94e494c16c78\": container with ID starting with 4b284ac6c381493aada9f905ce87bea16dbfc4bc236abf4cd71e94e494c16c78 not found: ID does not exist" Jul 21 15:05:40.168406 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:40.168374 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg"] Jul 21 15:05:40.170587 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:40.170566 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-449411-openshift-default-68b7d4c98c-s8pcg"] Jul 21 15:05:41.465699 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:41.465670 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86bb54d755-z9zzf_10f02733-b938-4db1-8386-94663104c507/manager/0.log" Jul 21 15:05:41.474552 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:41.474530 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86bb54d755-z9zzf_10f02733-b938-4db1-8386-94663104c507/copy-manifests/0.log" Jul 21 15:05:41.525935 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:41.525897 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38ee1ea3-9f80-4acc-983c-317a12c9cc40" path="/var/lib/kubelet/pods/38ee1ea3-9f80-4acc-983c-317a12c9cc40/volumes" Jul 21 15:05:43.072065 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:43.072033 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pk45q_f7e19c3f-a05f-48f6-adcf-ef759ab13b31/util/0.log" Jul 21 15:05:43.079474 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:43.079438 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pk45q_f7e19c3f-a05f-48f6-adcf-ef759ab13b31/pull/0.log" Jul 21 15:05:43.087931 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:43.087912 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pk45q_f7e19c3f-a05f-48f6-adcf-ef759ab13b31/extract/0.log" Jul 21 15:05:43.204097 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:43.204060 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jjvgd_e604d143-3a00-49a2-a7fc-6807d3dcf1c3/util/0.log" Jul 21 15:05:43.212141 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:43.212116 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jjvgd_e604d143-3a00-49a2-a7fc-6807d3dcf1c3/pull/0.log" Jul 21 15:05:43.219923 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:43.219902 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jjvgd_e604d143-3a00-49a2-a7fc-6807d3dcf1c3/extract/0.log" Jul 21 15:05:43.335419 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:43.335343 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nl4sl_851f7217-06ce-43af-aef3-59be5e50df3c/util/0.log" Jul 21 15:05:43.345973 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:43.345947 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nl4sl_851f7217-06ce-43af-aef3-59be5e50df3c/pull/0.log" Jul 21 15:05:43.353320 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:43.353299 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nl4sl_851f7217-06ce-43af-aef3-59be5e50df3c/extract/0.log" Jul 21 15:05:43.462860 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:43.462829 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19c2ft_3e724da8-d405-4665-b5b6-0f929b84444f/util/0.log" Jul 21 15:05:43.470605 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:43.470583 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19c2ft_3e724da8-d405-4665-b5b6-0f929b84444f/pull/0.log" Jul 21 15:05:43.478121 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:43.478102 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19c2ft_3e724da8-d405-4665-b5b6-0f929b84444f/extract/0.log" Jul 21 15:05:44.842492 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:44.842413 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678cdcdg_cb4e3f6d-7578-4166-87ff-51c04339867a/istio-proxy/0.log" Jul 21 15:05:44.967466 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:44.967434 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-jm9rj_5b7d62a9-f7e6-4896-860d-57b6fd3ff726/discovery/0.log" Jul 21 15:05:45.326954 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:45.326913 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-g9nb8_c4551f83-1828-4d44-831b-fe84051b1654/istio-proxy/1.log" Jul 21 15:05:45.446970 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:45.446937 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-jlwrw_e6b03f14-45dd-425e-91d2-f225435564f7/payload-pre-processing/0.log" Jul 21 15:05:46.059950 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:46.059921 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-gtz9r_21137ad7-e3d7-4898-ba72-5ecc2e63f9cf/main/0.log" Jul 21 15:05:46.300792 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:46.300750 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-q9lhj_6c585958-9593-40e3-a110-05e98c328232/main/0.log" Jul 21 15:05:46.551749 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:46.551709 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-2j54x_713b7a8c-d6a3-453f-adc3-184c13238b61/main/0.log" Jul 21 15:05:57.318662 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:57.318628 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-4r4d6_6ab945a0-5e72-4852-8a76-462020ef4af6/global-pull-secret-syncer/0.log" Jul 21 15:05:57.467511 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:57.467474 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-gfgt6_32d461fa-ba21-427d-b9de-24cceea9e7c1/konnectivity-agent/0.log" Jul 21 15:05:57.607749 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:05:57.607655 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-199.ec2.internal_1fa232d68d89be7b5a77b2100c544fdb/haproxy/0.log" Jul 21 15:06:02.038754 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:02.038723 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pk45q_f7e19c3f-a05f-48f6-adcf-ef759ab13b31/extract/0.log" Jul 21 15:06:02.097466 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:02.097439 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pk45q_f7e19c3f-a05f-48f6-adcf-ef759ab13b31/util/0.log" Jul 21 15:06:02.225815 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:02.225766 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pk45q_f7e19c3f-a05f-48f6-adcf-ef759ab13b31/pull/0.log" Jul 21 15:06:02.333814 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:02.333718 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jjvgd_e604d143-3a00-49a2-a7fc-6807d3dcf1c3/extract/0.log" Jul 21 15:06:02.377995 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:02.377964 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jjvgd_e604d143-3a00-49a2-a7fc-6807d3dcf1c3/util/0.log" Jul 21 15:06:02.419397 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:02.419363 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jjvgd_e604d143-3a00-49a2-a7fc-6807d3dcf1c3/pull/0.log" Jul 21 15:06:02.483399 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:02.483370 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nl4sl_851f7217-06ce-43af-aef3-59be5e50df3c/extract/0.log" Jul 21 15:06:02.522927 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:02.522901 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nl4sl_851f7217-06ce-43af-aef3-59be5e50df3c/util/0.log" Jul 21 15:06:02.560668 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:02.560638 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nl4sl_851f7217-06ce-43af-aef3-59be5e50df3c/pull/0.log" Jul 21 15:06:02.609109 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:02.609024 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19c2ft_3e724da8-d405-4665-b5b6-0f929b84444f/extract/0.log" Jul 21 15:06:02.649021 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:02.648992 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19c2ft_3e724da8-d405-4665-b5b6-0f929b84444f/util/0.log" Jul 21 15:06:02.689203 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:02.689168 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19c2ft_3e724da8-d405-4665-b5b6-0f929b84444f/pull/0.log" Jul 21 15:06:05.523491 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:05.523459 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_900ea2a0-98aa-41bc-b025-d1d579442fb1/alertmanager/0.log" Jul 21 15:06:05.556383 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:05.556351 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_900ea2a0-98aa-41bc-b025-d1d579442fb1/config-reloader/0.log" Jul 21 15:06:05.588176 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:05.588149 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_900ea2a0-98aa-41bc-b025-d1d579442fb1/kube-rbac-proxy-web/0.log" Jul 21 15:06:05.621658 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:05.621621 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_900ea2a0-98aa-41bc-b025-d1d579442fb1/kube-rbac-proxy/0.log" Jul 21 15:06:05.657809 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:05.657438 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_900ea2a0-98aa-41bc-b025-d1d579442fb1/kube-rbac-proxy-metric/0.log" Jul 21 15:06:05.689490 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:05.689456 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_900ea2a0-98aa-41bc-b025-d1d579442fb1/prom-label-proxy/0.log" Jul 21 15:06:05.723307 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:05.723277 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_900ea2a0-98aa-41bc-b025-d1d579442fb1/init-config-reloader/0.log" Jul 21 15:06:05.964822 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:05.964723 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-s6nlh_1edb1ef7-4c4c-40d8-a488-22bb5066e0b4/monitoring-plugin/0.log" Jul 21 15:06:06.005521 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:06.005488 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p26cs_3ae0a42a-7de4-4142-9326-059cf91b3a1e/node-exporter/0.log" Jul 21 15:06:06.033937 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:06.033907 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p26cs_3ae0a42a-7de4-4142-9326-059cf91b3a1e/kube-rbac-proxy/0.log" Jul 21 15:06:06.074952 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:06.074920 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p26cs_3ae0a42a-7de4-4142-9326-059cf91b3a1e/init-textfile/0.log" Jul 21 15:06:06.324798 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:06.324745 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-6pbqt_48b8c55c-66f2-45af-89fc-590ce1c54f44/kube-rbac-proxy-main/0.log" Jul 21 15:06:06.360842 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:06.360773 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-6pbqt_48b8c55c-66f2-45af-89fc-590ce1c54f44/kube-rbac-proxy-self/0.log" Jul 21 15:06:06.393654 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:06.393612 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-6pbqt_48b8c55c-66f2-45af-89fc-590ce1c54f44/openshift-state-metrics/0.log" Jul 21 15:06:06.662396 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:06.662294 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-tdgzg_cbf75b07-d001-4306-b1c4-739f89f1ddf5/prometheus-operator/0.log" Jul 21 15:06:06.688319 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:06.688293 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-tdgzg_cbf75b07-d001-4306-b1c4-739f89f1ddf5/kube-rbac-proxy/0.log" Jul 21 15:06:06.719392 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:06.719360 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-c25fw_7be8e2df-8100-4d6b-8cfe-b578b5199099/prometheus-operator-admission-webhook/0.log" Jul 21 15:06:06.766145 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:06.766121 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-655f85b7c8-9p5hs_0cc17485-2b48-4d45-a8be-f1048ef1e7f8/telemeter-client/0.log" Jul 21 15:06:06.796852 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:06.796820 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-655f85b7c8-9p5hs_0cc17485-2b48-4d45-a8be-f1048ef1e7f8/reload/0.log" Jul 21 15:06:06.830096 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:06.830071 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-655f85b7c8-9p5hs_0cc17485-2b48-4d45-a8be-f1048ef1e7f8/kube-rbac-proxy/0.log" Jul 21 15:06:06.874175 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:06.874146 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-786f77dcf4-bw2qh_6b85723a-2710-4317-b453-4f2b63eb6478/thanos-query/0.log" Jul 21 15:06:06.904136 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:06.904109 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-786f77dcf4-bw2qh_6b85723a-2710-4317-b453-4f2b63eb6478/kube-rbac-proxy-web/0.log" Jul 21 15:06:06.933190 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:06.933110 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-786f77dcf4-bw2qh_6b85723a-2710-4317-b453-4f2b63eb6478/kube-rbac-proxy/0.log" Jul 21 15:06:06.962500 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:06.962471 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-786f77dcf4-bw2qh_6b85723a-2710-4317-b453-4f2b63eb6478/prom-label-proxy/0.log" Jul 21 15:06:07.000111 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:07.000083 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-786f77dcf4-bw2qh_6b85723a-2710-4317-b453-4f2b63eb6478/kube-rbac-proxy-rules/0.log" Jul 21 15:06:07.033174 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:07.033145 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-786f77dcf4-bw2qh_6b85723a-2710-4317-b453-4f2b63eb6478/kube-rbac-proxy-metrics/0.log" Jul 21 15:06:08.044570 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:08.044531 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5jhqw/perf-node-gather-daemonset-b7lss"] Jul 21 15:06:08.045100 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:08.044968 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4aa1c92-4af0-4b8b-a7b8-d322c4904370" containerName="istio-proxy" Jul 21 15:06:08.045100 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:08.044981 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4aa1c92-4af0-4b8b-a7b8-d322c4904370" containerName="istio-proxy" Jul 21 15:06:08.045100 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:08.044991 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38ee1ea3-9f80-4acc-983c-317a12c9cc40" containerName="istio-proxy" Jul 21 15:06:08.045100 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:08.044997 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="38ee1ea3-9f80-4acc-983c-317a12c9cc40" containerName="istio-proxy" Jul 21 15:06:08.045100 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:08.045005 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38ee1ea3-9f80-4acc-983c-317a12c9cc40" containerName="istio-proxy" Jul 21 15:06:08.045100 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:08.045011 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="38ee1ea3-9f80-4acc-983c-317a12c9cc40" containerName="istio-proxy" Jul 21 15:06:08.045100 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:08.045020 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4aa1c92-4af0-4b8b-a7b8-d322c4904370" containerName="istio-proxy" Jul 21 15:06:08.045100 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:08.045025 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4aa1c92-4af0-4b8b-a7b8-d322c4904370" containerName="istio-proxy" Jul 21 15:06:08.045100 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:08.045102 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="38ee1ea3-9f80-4acc-983c-317a12c9cc40" containerName="istio-proxy" Jul 21 15:06:08.045410 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:08.045113 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4aa1c92-4af0-4b8b-a7b8-d322c4904370" containerName="istio-proxy" Jul 21 15:06:08.045410 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:08.045120 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4aa1c92-4af0-4b8b-a7b8-d322c4904370" containerName="istio-proxy" Jul 21 15:06:08.045410 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:08.045126 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="38ee1ea3-9f80-4acc-983c-317a12c9cc40" containerName="istio-proxy" Jul 21 15:06:08.048230 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:08.048207 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5jhqw/perf-node-gather-daemonset-b7lss" Jul 21 15:06:08.050989 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:08.050958 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-5jhqw\"/\"default-dockercfg-lz5ll\"" Jul 21 15:06:08.051139 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:08.050988 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5jhqw\"/\"openshift-service-ca.crt\"" Jul 21 15:06:08.052012 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:08.051989 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5jhqw\"/\"kube-root-ca.crt\"" Jul 21 15:06:08.068700 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:08.068664 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5jhqw/perf-node-gather-daemonset-b7lss"] Jul 21 15:06:08.180432 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:08.180389 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cb43f2ee-02e9-4a39-b48e-ab14ead4c77c-proc\") pod \"perf-node-gather-daemonset-b7lss\" (UID: \"cb43f2ee-02e9-4a39-b48e-ab14ead4c77c\") " pod="openshift-must-gather-5jhqw/perf-node-gather-daemonset-b7lss" Jul 21 15:06:08.180432 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:08.180434 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cb43f2ee-02e9-4a39-b48e-ab14ead4c77c-lib-modules\") pod \"perf-node-gather-daemonset-b7lss\" (UID: \"cb43f2ee-02e9-4a39-b48e-ab14ead4c77c\") " pod="openshift-must-gather-5jhqw/perf-node-gather-daemonset-b7lss" Jul 21 15:06:08.180656 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:08.180465 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cb43f2ee-02e9-4a39-b48e-ab14ead4c77c-podres\") pod \"perf-node-gather-daemonset-b7lss\" (UID: \"cb43f2ee-02e9-4a39-b48e-ab14ead4c77c\") " pod="openshift-must-gather-5jhqw/perf-node-gather-daemonset-b7lss" Jul 21 15:06:08.180656 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:08.180497 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cb43f2ee-02e9-4a39-b48e-ab14ead4c77c-sys\") pod \"perf-node-gather-daemonset-b7lss\" (UID: \"cb43f2ee-02e9-4a39-b48e-ab14ead4c77c\") " pod="openshift-must-gather-5jhqw/perf-node-gather-daemonset-b7lss" Jul 21 15:06:08.180656 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:08.180591 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fx6j8\" (UniqueName: \"kubernetes.io/projected/cb43f2ee-02e9-4a39-b48e-ab14ead4c77c-kube-api-access-fx6j8\") pod \"perf-node-gather-daemonset-b7lss\" (UID: \"cb43f2ee-02e9-4a39-b48e-ab14ead4c77c\") " pod="openshift-must-gather-5jhqw/perf-node-gather-daemonset-b7lss" Jul 21 15:06:08.281317 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:08.281276 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fx6j8\" (UniqueName: \"kubernetes.io/projected/cb43f2ee-02e9-4a39-b48e-ab14ead4c77c-kube-api-access-fx6j8\") pod \"perf-node-gather-daemonset-b7lss\" (UID: \"cb43f2ee-02e9-4a39-b48e-ab14ead4c77c\") " pod="openshift-must-gather-5jhqw/perf-node-gather-daemonset-b7lss" Jul 21 15:06:08.281495 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:08.281444 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cb43f2ee-02e9-4a39-b48e-ab14ead4c77c-proc\") pod \"perf-node-gather-daemonset-b7lss\" (UID: \"cb43f2ee-02e9-4a39-b48e-ab14ead4c77c\") " pod="openshift-must-gather-5jhqw/perf-node-gather-daemonset-b7lss" Jul 21 15:06:08.281495 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:08.281481 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cb43f2ee-02e9-4a39-b48e-ab14ead4c77c-lib-modules\") pod \"perf-node-gather-daemonset-b7lss\" (UID: \"cb43f2ee-02e9-4a39-b48e-ab14ead4c77c\") " pod="openshift-must-gather-5jhqw/perf-node-gather-daemonset-b7lss" Jul 21 15:06:08.281589 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:08.281505 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cb43f2ee-02e9-4a39-b48e-ab14ead4c77c-podres\") pod \"perf-node-gather-daemonset-b7lss\" (UID: \"cb43f2ee-02e9-4a39-b48e-ab14ead4c77c\") " pod="openshift-must-gather-5jhqw/perf-node-gather-daemonset-b7lss" Jul 21 15:06:08.281589 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:08.281531 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cb43f2ee-02e9-4a39-b48e-ab14ead4c77c-sys\") pod \"perf-node-gather-daemonset-b7lss\" (UID: \"cb43f2ee-02e9-4a39-b48e-ab14ead4c77c\") " pod="openshift-must-gather-5jhqw/perf-node-gather-daemonset-b7lss" Jul 21 15:06:08.281589 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:08.281562 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cb43f2ee-02e9-4a39-b48e-ab14ead4c77c-proc\") pod \"perf-node-gather-daemonset-b7lss\" (UID: \"cb43f2ee-02e9-4a39-b48e-ab14ead4c77c\") " pod="openshift-must-gather-5jhqw/perf-node-gather-daemonset-b7lss" Jul 21 15:06:08.281693 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:08.281616 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cb43f2ee-02e9-4a39-b48e-ab14ead4c77c-sys\") pod \"perf-node-gather-daemonset-b7lss\" (UID: \"cb43f2ee-02e9-4a39-b48e-ab14ead4c77c\") " pod="openshift-must-gather-5jhqw/perf-node-gather-daemonset-b7lss" Jul 21 15:06:08.281693 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:08.281626 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cb43f2ee-02e9-4a39-b48e-ab14ead4c77c-lib-modules\") pod \"perf-node-gather-daemonset-b7lss\" (UID: \"cb43f2ee-02e9-4a39-b48e-ab14ead4c77c\") " pod="openshift-must-gather-5jhqw/perf-node-gather-daemonset-b7lss" Jul 21 15:06:08.281693 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:08.281635 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cb43f2ee-02e9-4a39-b48e-ab14ead4c77c-podres\") pod \"perf-node-gather-daemonset-b7lss\" (UID: \"cb43f2ee-02e9-4a39-b48e-ab14ead4c77c\") " pod="openshift-must-gather-5jhqw/perf-node-gather-daemonset-b7lss" Jul 21 15:06:08.290746 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:08.290707 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fx6j8\" (UniqueName: \"kubernetes.io/projected/cb43f2ee-02e9-4a39-b48e-ab14ead4c77c-kube-api-access-fx6j8\") pod \"perf-node-gather-daemonset-b7lss\" (UID: \"cb43f2ee-02e9-4a39-b48e-ab14ead4c77c\") " pod="openshift-must-gather-5jhqw/perf-node-gather-daemonset-b7lss" Jul 21 15:06:08.358534 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:08.358438 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5jhqw/perf-node-gather-daemonset-b7lss" Jul 21 15:06:08.509342 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:08.509311 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5jhqw/perf-node-gather-daemonset-b7lss"] Jul 21 15:06:08.510942 ip-10-0-140-199 kubenswrapper[2576]: W0721 15:06:08.510910 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podcb43f2ee_02e9_4a39_b48e_ab14ead4c77c.slice/crio-5b6c9d0ad03eb02630874aa093a09ef8b6d81b7ec6a93ad7f0d1478f14d97491 WatchSource:0}: Error finding container 5b6c9d0ad03eb02630874aa093a09ef8b6d81b7ec6a93ad7f0d1478f14d97491: Status 404 returned error can't find the container with id 5b6c9d0ad03eb02630874aa093a09ef8b6d81b7ec6a93ad7f0d1478f14d97491 Jul 21 15:06:09.302169 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:09.302128 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5jhqw/perf-node-gather-daemonset-b7lss" event={"ID":"cb43f2ee-02e9-4a39-b48e-ab14ead4c77c","Type":"ContainerStarted","Data":"9c95f05e5f20ffe2763c7da5b05d5f7d2b398ae49460e125e75328cc786053ce"} Jul 21 15:06:09.302742 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:09.302202 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-5jhqw/perf-node-gather-daemonset-b7lss" Jul 21 15:06:09.302742 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:09.302229 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5jhqw/perf-node-gather-daemonset-b7lss" event={"ID":"cb43f2ee-02e9-4a39-b48e-ab14ead4c77c","Type":"ContainerStarted","Data":"5b6c9d0ad03eb02630874aa093a09ef8b6d81b7ec6a93ad7f0d1478f14d97491"} Jul 21 15:06:09.326346 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:09.326276 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-5jhqw/perf-node-gather-daemonset-b7lss" podStartSLOduration=1.326253304 podStartE2EDuration="1.326253304s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 15:06:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:06:09.32513862 +0000 UTC m=+2896.343042196" watchObservedRunningTime="2026-07-21 15:06:09.326253304 +0000 UTC m=+2896.344156881" Jul 21 15:06:09.351154 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:09.351120 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-dwdzd_7ab873ea-a45a-4aae-93ec-54ce3552389d/download-server/0.log" Jul 21 15:06:11.232599 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:11.232570 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-d97tp_bd89fdab-5ed9-4b58-a200-2816c4cf6307/dns/0.log" Jul 21 15:06:11.269757 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:11.269731 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-d97tp_bd89fdab-5ed9-4b58-a200-2816c4cf6307/kube-rbac-proxy/0.log" Jul 21 15:06:11.402873 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:11.402834 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-b5kkg_08737a2e-4e32-441c-b905-c2a2e41b1d17/dns-node-resolver/0.log" Jul 21 15:06:12.187180 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:12.187146 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nxm5s_8ccfca56-0054-4006-be8c-2fb53147addd/node-ca/0.log" Jul 21 15:06:13.260143 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:13.260112 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678cdcdg_cb4e3f6d-7578-4166-87ff-51c04339867a/istio-proxy/0.log" Jul 21 15:06:13.397232 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:13.397196 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-jm9rj_5b7d62a9-f7e6-4896-860d-57b6fd3ff726/discovery/0.log" Jul 21 15:06:13.489985 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:13.489952 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-g9nb8_c4551f83-1828-4d44-831b-fe84051b1654/istio-proxy/0.log" Jul 21 15:06:13.515358 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:13.515275 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-g9nb8_c4551f83-1828-4d44-831b-fe84051b1654/istio-proxy/1.log" Jul 21 15:06:13.547179 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:13.547148 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-jlwrw_e6b03f14-45dd-425e-91d2-f225435564f7/payload-pre-processing/0.log" Jul 21 15:06:14.417351 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:14.417321 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-g4d47_7fbd7107-aae1-4e1a-ab14-7cd5830010b4/serve-healthcheck-canary/0.log" Jul 21 15:06:15.273003 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:15.272975 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zrtj8_6c7af6c4-9136-4fbe-a126-fb15ac1b568f/kube-rbac-proxy/0.log" Jul 21 15:06:15.305219 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:15.305178 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zrtj8_6c7af6c4-9136-4fbe-a126-fb15ac1b568f/exporter/0.log" Jul 21 15:06:15.318052 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:15.318016 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-5jhqw/perf-node-gather-daemonset-b7lss" Jul 21 15:06:15.333138 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:15.333112 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zrtj8_6c7af6c4-9136-4fbe-a126-fb15ac1b568f/extractor/0.log" Jul 21 15:06:18.087666 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:18.087637 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678cdcdg_cb4e3f6d-7578-4166-87ff-51c04339867a/istio-proxy/0.log" Jul 21 15:06:18.216484 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:18.216458 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-jm9rj_5b7d62a9-f7e6-4896-860d-57b6fd3ff726/discovery/0.log" Jul 21 15:06:18.274407 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:18.274378 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-g9nb8_c4551f83-1828-4d44-831b-fe84051b1654/istio-proxy/0.log" Jul 21 15:06:18.299888 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:18.299842 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-g9nb8_c4551f83-1828-4d44-831b-fe84051b1654/istio-proxy/1.log" Jul 21 15:06:18.324899 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:18.324864 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-jlwrw_e6b03f14-45dd-425e-91d2-f225435564f7/payload-pre-processing/0.log" Jul 21 15:06:18.822909 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:18.822880 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86bb54d755-z9zzf_10f02733-b938-4db1-8386-94663104c507/manager/0.log" Jul 21 15:06:18.853170 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:18.853140 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86bb54d755-z9zzf_10f02733-b938-4db1-8386-94663104c507/copy-manifests/0.log" Jul 21 15:06:19.551415 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:19.551385 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678cdcdg_cb4e3f6d-7578-4166-87ff-51c04339867a/istio-proxy/0.log" Jul 21 15:06:19.675937 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:19.675905 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-jm9rj_5b7d62a9-f7e6-4896-860d-57b6fd3ff726/discovery/0.log" Jul 21 15:06:19.741756 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:19.741726 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-g9nb8_c4551f83-1828-4d44-831b-fe84051b1654/istio-proxy/0.log" Jul 21 15:06:19.770360 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:19.770338 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-g9nb8_c4551f83-1828-4d44-831b-fe84051b1654/istio-proxy/1.log" Jul 21 15:06:19.807975 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:19.807945 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-jlwrw_e6b03f14-45dd-425e-91d2-f225435564f7/payload-pre-processing/0.log" Jul 21 15:06:20.231438 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:20.231367 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6df87d547c-ljzmk_2c2c6c31-dd66-4948-b1bb-40c66731ef68/manager/0.log" Jul 21 15:06:20.265326 ip-10-0-140-199 kubenswrapper[2576]: I0721 15:06:20.265300 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-tbs6k_59024c9f-5454-436a-8f32-d32aeb5af19c/openshift-lws-operator/0.log"