Jul 11 01:06:33.911150 ip-10-0-138-161 systemd[1]: Starting Kubernetes Kubelet... Jul 11 01:06:34.455146 ip-10-0-138-161 systemd[1]: Started Kubernetes Kubelet. Jul 11 01:06:34.462085 ip-10-0-138-161 kubenswrapper[2572]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 11 01:06:34.462085 ip-10-0-138-161 kubenswrapper[2572]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 11 01:06:34.462085 ip-10-0-138-161 kubenswrapper[2572]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 11 01:06:34.462085 ip-10-0-138-161 kubenswrapper[2572]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 11 01:06:34.462085 ip-10-0-138-161 kubenswrapper[2572]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 11 01:06:34.462085 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.380133 2572 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 11 01:06:34.462085 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384524 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 11 01:06:34.462085 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384535 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 11 01:06:34.462085 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384540 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 11 01:06:34.462085 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384543 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 11 01:06:34.462085 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384546 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 11 01:06:34.462085 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384549 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 11 01:06:34.462085 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384552 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 11 01:06:34.462085 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384555 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 11 01:06:34.463020 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384557 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 11 01:06:34.463020 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384560 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 11 01:06:34.463020 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384563 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 11 01:06:34.463020 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384565 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 11 01:06:34.463020 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384568 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 11 01:06:34.463020 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384571 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 11 01:06:34.463020 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384574 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 11 01:06:34.463020 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384578 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 11 01:06:34.463020 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384582 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 11 01:06:34.463020 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384585 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 11 01:06:34.463020 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384588 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 11 01:06:34.463020 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384590 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 11 01:06:34.463020 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384593 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 11 01:06:34.463020 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384596 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 11 01:06:34.463020 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384599 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 11 01:06:34.463020 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384602 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 11 01:06:34.463020 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384606 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 11 01:06:34.463020 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384608 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 11 01:06:34.463020 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384611 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 11 01:06:34.463020 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384614 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 11 01:06:34.463830 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384618 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 11 01:06:34.463830 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384620 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 11 01:06:34.463830 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384623 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 11 01:06:34.463830 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384626 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 11 01:06:34.463830 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384629 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 11 01:06:34.463830 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384633 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 11 01:06:34.463830 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384636 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 11 01:06:34.463830 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384639 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 11 01:06:34.463830 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384642 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 11 01:06:34.463830 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384645 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 11 01:06:34.463830 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384648 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 11 01:06:34.463830 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384651 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 11 01:06:34.463830 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384673 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 11 01:06:34.463830 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384677 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 11 01:06:34.463830 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384680 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 11 01:06:34.463830 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384684 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 11 01:06:34.463830 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384687 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 11 01:06:34.463830 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384690 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 11 01:06:34.463830 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384693 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 11 01:06:36.070476 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384696 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 11 01:06:36.070476 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384699 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 11 01:06:36.070476 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384702 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 11 01:06:36.070476 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384705 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 11 01:06:36.070476 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384708 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 11 01:06:36.070476 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384712 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 11 01:06:36.070476 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384715 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 11 01:06:36.070476 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384719 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 11 01:06:36.070476 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384721 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 11 01:06:36.070476 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384724 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 11 01:06:36.070476 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384727 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 11 01:06:36.070476 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384729 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 11 01:06:36.070476 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384732 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 11 01:06:36.070476 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384735 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 11 01:06:36.070476 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384737 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 11 01:06:36.070476 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384740 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 11 01:06:36.070476 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384742 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 11 01:06:36.070476 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384745 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 11 01:06:36.070476 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384747 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 11 01:06:36.071522 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384749 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 11 01:06:36.071522 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384752 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 11 01:06:36.071522 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384755 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 11 01:06:36.071522 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384758 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 11 01:06:36.071522 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384760 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 11 01:06:36.071522 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384763 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 11 01:06:36.071522 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384766 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 11 01:06:36.071522 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384770 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 11 01:06:36.071522 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384772 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 11 01:06:36.071522 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384776 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 11 01:06:36.071522 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384778 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 11 01:06:36.071522 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384781 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 11 01:06:36.071522 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384783 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 11 01:06:36.071522 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384786 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 11 01:06:36.071522 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384788 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 11 01:06:36.071522 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384791 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 11 01:06:36.071522 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384793 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 11 01:06:36.071522 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384795 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 11 01:06:36.071522 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384798 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 11 01:06:36.071522 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384801 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 11 01:06:36.072400 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384804 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 11 01:06:36.072400 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384806 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 11 01:06:36.072400 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384809 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 11 01:06:36.072400 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384811 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 11 01:06:36.072400 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384814 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 11 01:06:36.072400 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384816 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 11 01:06:36.072400 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384819 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 11 01:06:36.072400 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384822 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 11 01:06:36.072400 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384824 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 11 01:06:36.072400 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384827 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 11 01:06:36.072400 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384829 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 11 01:06:36.072400 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384832 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 11 01:06:36.072400 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.384834 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 11 01:06:36.072400 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385543 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 11 01:06:36.072400 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385549 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 11 01:06:36.072400 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385552 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 11 01:06:36.072400 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385555 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 11 01:06:36.072400 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385559 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 11 01:06:36.072400 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385562 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 11 01:06:36.072400 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385565 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 11 01:06:36.072400 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385568 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 11 01:06:36.073537 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385571 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 11 01:06:36.073537 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385575 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 11 01:06:36.073537 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385578 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 11 01:06:36.073537 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385580 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 11 01:06:36.073537 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385583 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 11 01:06:36.073537 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385585 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 11 01:06:36.073537 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385588 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 11 01:06:36.073537 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385590 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 11 01:06:36.073537 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385593 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 11 01:06:36.073537 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385595 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 11 01:06:36.073537 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385598 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 11 01:06:36.073537 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385600 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 11 01:06:36.073537 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385603 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 11 01:06:36.073537 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385605 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 11 01:06:36.073537 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385608 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 11 01:06:36.073537 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385610 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 11 01:06:36.073537 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385615 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 11 01:06:36.073537 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385618 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 11 01:06:36.073537 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385621 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 11 01:06:36.073537 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385624 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 11 01:06:36.074556 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385626 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 11 01:06:36.074556 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385629 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 11 01:06:36.074556 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385631 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 11 01:06:36.074556 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385634 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 11 01:06:36.074556 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385636 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 11 01:06:36.074556 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385639 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 11 01:06:36.074556 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385641 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 11 01:06:36.074556 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385644 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 11 01:06:36.074556 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385646 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 11 01:06:36.074556 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385649 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 11 01:06:36.074556 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385655 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 11 01:06:36.074556 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385659 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 11 01:06:36.074556 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385662 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 11 01:06:36.074556 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385664 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 11 01:06:36.074556 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385667 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 11 01:06:36.074556 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385670 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 11 01:06:36.074556 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385674 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 11 01:06:36.074556 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385677 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 11 01:06:36.074556 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385680 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 11 01:06:36.074556 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385683 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 11 01:06:36.075619 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385686 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 11 01:06:36.075619 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385688 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 11 01:06:36.075619 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385692 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 11 01:06:36.075619 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385695 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 11 01:06:36.075619 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385697 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 11 01:06:36.075619 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385700 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 11 01:06:36.075619 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385703 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 11 01:06:36.075619 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385706 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 11 01:06:36.075619 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385708 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 11 01:06:36.075619 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385711 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 11 01:06:36.075619 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385713 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 11 01:06:36.075619 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385716 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 11 01:06:36.075619 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385718 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 11 01:06:36.075619 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385721 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 11 01:06:36.075619 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385723 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 11 01:06:36.075619 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385726 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 11 01:06:36.075619 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385728 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 11 01:06:36.075619 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385731 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 11 01:06:36.075619 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385734 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 11 01:06:36.076511 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385737 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 11 01:06:36.076511 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385739 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 11 01:06:36.076511 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385742 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 11 01:06:36.076511 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385745 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 11 01:06:36.076511 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385748 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 11 01:06:36.076511 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385751 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 11 01:06:36.076511 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385753 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 11 01:06:36.076511 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385757 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 11 01:06:36.076511 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385759 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 11 01:06:36.076511 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385762 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 11 01:06:36.076511 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385764 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 11 01:06:36.076511 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385767 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 11 01:06:36.076511 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385770 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 11 01:06:36.076511 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385772 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 11 01:06:36.076511 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385775 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 11 01:06:36.076511 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385777 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 11 01:06:36.076511 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385779 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 11 01:06:36.076511 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385782 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 11 01:06:36.076511 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385784 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 11 01:06:36.077399 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385787 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 11 01:06:36.077399 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385789 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 11 01:06:36.077399 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385792 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 11 01:06:36.077399 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385794 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 11 01:06:36.077399 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385797 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 11 01:06:36.077399 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385799 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 11 01:06:36.077399 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385802 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 11 01:06:36.077399 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385804 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 11 01:06:36.077399 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385809 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 11 01:06:36.077399 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385812 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 11 01:06:36.077399 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385814 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 11 01:06:36.077399 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385817 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 11 01:06:36.077399 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.385819 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 11 01:06:36.077399 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386212 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 11 01:06:36.077399 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386217 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 11 01:06:36.077399 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386220 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 11 01:06:36.077399 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386223 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 11 01:06:36.077399 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386226 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 11 01:06:36.077399 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386229 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 11 01:06:36.077399 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386231 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 11 01:06:36.078388 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386234 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 11 01:06:36.078388 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386236 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 11 01:06:36.078388 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386239 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 11 01:06:36.078388 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386241 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 11 01:06:36.078388 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386244 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 11 01:06:36.078388 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386246 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 11 01:06:36.078388 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386248 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 11 01:06:36.078388 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386251 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 11 01:06:36.078388 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386254 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 11 01:06:36.078388 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386257 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 11 01:06:36.078388 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386260 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 11 01:06:36.078388 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386262 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 11 01:06:36.078388 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386265 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 11 01:06:36.078388 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386267 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 11 01:06:36.078388 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386270 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 11 01:06:36.078388 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386273 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 11 01:06:36.078388 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386275 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 11 01:06:36.078388 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386278 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 11 01:06:36.078388 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386281 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 11 01:06:36.078388 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386284 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 11 01:06:36.079371 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386288 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 11 01:06:36.079371 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386293 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 11 01:06:36.079371 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386296 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 11 01:06:36.079371 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386299 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 11 01:06:36.079371 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386302 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 11 01:06:36.079371 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386305 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 11 01:06:36.079371 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386307 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 11 01:06:36.079371 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386310 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 11 01:06:36.079371 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386312 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 11 01:06:36.079371 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386314 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 11 01:06:36.079371 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386318 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 11 01:06:36.079371 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386320 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 11 01:06:36.079371 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386323 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 11 01:06:36.079371 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386326 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 11 01:06:36.079371 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386328 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 11 01:06:36.079371 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386331 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 11 01:06:36.079371 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386334 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 11 01:06:36.079371 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386337 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 11 01:06:36.079371 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386339 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 11 01:06:36.079371 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386342 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 11 01:06:36.080227 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386344 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 11 01:06:36.080227 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386347 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 11 01:06:36.080227 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386350 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 11 01:06:36.080227 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386352 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 11 01:06:36.080227 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386355 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 11 01:06:36.080227 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386357 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 11 01:06:36.080227 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386359 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 11 01:06:36.080227 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386362 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 11 01:06:36.080227 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386365 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 11 01:06:36.080227 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386368 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 11 01:06:36.080227 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386370 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 11 01:06:36.080227 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386373 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 11 01:06:36.080227 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386377 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 11 01:06:36.080227 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386379 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 11 01:06:36.080227 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386382 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 11 01:06:36.080227 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386384 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 11 01:06:36.080227 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386386 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 11 01:06:36.080227 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386389 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 11 01:06:36.080227 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386391 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 11 01:06:36.080227 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386394 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 11 01:06:36.080882 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386397 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 11 01:06:36.080882 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386399 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 11 01:06:36.080882 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386402 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 11 01:06:36.080882 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386405 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 11 01:06:36.080882 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386408 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 11 01:06:36.080882 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386410 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 11 01:06:36.080882 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386413 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 11 01:06:36.080882 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386416 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 11 01:06:36.080882 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386419 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 11 01:06:36.080882 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386422 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 11 01:06:36.080882 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386426 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 11 01:06:36.080882 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386428 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 11 01:06:36.080882 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386431 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 11 01:06:36.080882 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386433 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 11 01:06:36.080882 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386435 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 11 01:06:36.080882 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386438 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 11 01:06:36.080882 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386440 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 11 01:06:36.080882 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386443 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 11 01:06:36.080882 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386446 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 11 01:06:36.081957 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386448 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 11 01:06:36.081957 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386451 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 11 01:06:36.081957 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386457 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 11 01:06:36.081957 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386460 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 11 01:06:36.081957 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386462 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 11 01:06:36.081957 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386466 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 11 01:06:36.081957 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386469 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 11 01:06:36.081957 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386471 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 11 01:06:36.081957 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386474 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 11 01:06:36.081957 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386476 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 11 01:06:36.081957 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386479 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 11 01:06:36.081957 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386483 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 11 01:06:36.081957 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.386486 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 11 01:06:36.081957 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386552 2572 flags.go:64] FLAG: --address="0.0.0.0" Jul 11 01:06:36.081957 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386559 2572 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 11 01:06:36.081957 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386566 2572 flags.go:64] FLAG: --anonymous-auth="true" Jul 11 01:06:36.081957 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386570 2572 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 11 01:06:36.081957 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386584 2572 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 11 01:06:36.081957 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386587 2572 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 11 01:06:36.081957 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386591 2572 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 11 01:06:36.081957 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386595 2572 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 11 01:06:36.083163 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386598 2572 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 11 01:06:36.083163 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386601 2572 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 11 01:06:36.083163 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386605 2572 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 11 01:06:36.083163 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386608 2572 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 11 01:06:36.083163 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386611 2572 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 11 01:06:36.083163 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386614 2572 flags.go:64] FLAG: --cgroup-root="" Jul 11 01:06:36.083163 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386617 2572 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 11 01:06:36.083163 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386620 2572 flags.go:64] FLAG: --client-ca-file="" Jul 11 01:06:36.083163 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386623 2572 flags.go:64] FLAG: --cloud-provider="external" Jul 11 01:06:36.083163 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386626 2572 flags.go:64] FLAG: --cluster-dns="[]" Jul 11 01:06:36.083163 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386630 2572 flags.go:64] FLAG: --cluster-domain="" Jul 11 01:06:36.083163 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386633 2572 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 11 01:06:36.083163 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386636 2572 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 11 01:06:36.083163 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386640 2572 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 11 01:06:36.083163 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386644 2572 flags.go:64] FLAG: --container-log-max-files="5" Jul 11 01:06:36.083163 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386647 2572 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 11 01:06:36.083163 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386652 2572 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 11 01:06:36.083163 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386655 2572 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 11 01:06:36.083163 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386659 2572 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 11 01:06:36.083163 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386662 2572 flags.go:64] FLAG: --contention-profiling="false" Jul 11 01:06:36.083163 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386665 2572 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 11 01:06:36.083163 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386668 2572 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 11 01:06:36.083163 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386671 2572 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 11 01:06:36.083163 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386674 2572 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 11 01:06:36.084132 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386677 2572 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 11 01:06:36.084132 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386681 2572 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 11 01:06:36.084132 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386683 2572 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 11 01:06:36.084132 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386686 2572 flags.go:64] FLAG: --enable-load-reader="false" Jul 11 01:06:36.084132 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386689 2572 flags.go:64] FLAG: --enable-server="true" Jul 11 01:06:36.084132 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386698 2572 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 11 01:06:36.084132 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386704 2572 flags.go:64] FLAG: --event-burst="100" Jul 11 01:06:36.084132 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386707 2572 flags.go:64] FLAG: --event-qps="50" Jul 11 01:06:36.084132 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386710 2572 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 11 01:06:36.084132 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386713 2572 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 11 01:06:36.084132 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386716 2572 flags.go:64] FLAG: --eviction-hard="" Jul 11 01:06:36.084132 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386720 2572 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 11 01:06:36.084132 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386723 2572 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 11 01:06:36.084132 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386726 2572 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 11 01:06:36.084132 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386729 2572 flags.go:64] FLAG: --eviction-soft="" Jul 11 01:06:36.084132 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386732 2572 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 11 01:06:36.084132 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386735 2572 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 11 01:06:36.084132 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386737 2572 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 11 01:06:36.084132 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386740 2572 flags.go:64] FLAG: --experimental-mounter-path="" Jul 11 01:06:36.084132 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386743 2572 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 11 01:06:36.084132 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386746 2572 flags.go:64] FLAG: --fail-swap-on="true" Jul 11 01:06:36.084132 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386750 2572 flags.go:64] FLAG: --feature-gates="" Jul 11 01:06:36.084132 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386754 2572 flags.go:64] FLAG: --file-check-frequency="20s" Jul 11 01:06:36.084132 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386757 2572 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 11 01:06:36.084132 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386761 2572 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 11 01:06:36.085221 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386764 2572 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 11 01:06:36.085221 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386767 2572 flags.go:64] FLAG: --healthz-port="10248" Jul 11 01:06:36.085221 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386770 2572 flags.go:64] FLAG: --help="false" Jul 11 01:06:36.085221 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386773 2572 flags.go:64] FLAG: --hostname-override="ip-10-0-138-161.ec2.internal" Jul 11 01:06:36.085221 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386776 2572 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 11 01:06:36.085221 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386779 2572 flags.go:64] FLAG: --http-check-frequency="20s" Jul 11 01:06:36.085221 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386782 2572 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 11 01:06:36.085221 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386786 2572 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 11 01:06:36.085221 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386789 2572 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 11 01:06:36.085221 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386792 2572 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 11 01:06:36.085221 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386794 2572 flags.go:64] FLAG: --image-service-endpoint="" Jul 11 01:06:36.085221 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386797 2572 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 11 01:06:36.085221 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386800 2572 flags.go:64] FLAG: --kube-api-burst="100" Jul 11 01:06:36.085221 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386809 2572 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 11 01:06:36.085221 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386813 2572 flags.go:64] FLAG: --kube-api-qps="50" Jul 11 01:06:36.085221 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386815 2572 flags.go:64] FLAG: --kube-reserved="" Jul 11 01:06:36.085221 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386818 2572 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 11 01:06:36.085221 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386821 2572 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 11 01:06:36.085221 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386825 2572 flags.go:64] FLAG: --kubelet-cgroups="" Jul 11 01:06:36.085221 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386828 2572 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 11 01:06:36.085221 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386830 2572 flags.go:64] FLAG: --lock-file="" Jul 11 01:06:36.085221 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386833 2572 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 11 01:06:36.085221 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386836 2572 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 11 01:06:36.085221 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386839 2572 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 11 01:06:36.086762 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386844 2572 flags.go:64] FLAG: --log-json-split-stream="false" Jul 11 01:06:36.086762 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386847 2572 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 11 01:06:36.086762 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386850 2572 flags.go:64] FLAG: --log-text-split-stream="false" Jul 11 01:06:36.086762 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386852 2572 flags.go:64] FLAG: --logging-format="text" Jul 11 01:06:36.086762 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386857 2572 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 11 01:06:36.086762 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386860 2572 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 11 01:06:36.086762 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386863 2572 flags.go:64] FLAG: --manifest-url="" Jul 11 01:06:36.086762 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386868 2572 flags.go:64] FLAG: --manifest-url-header="" Jul 11 01:06:36.086762 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386872 2572 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 11 01:06:36.086762 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386875 2572 flags.go:64] FLAG: --max-open-files="1000000" Jul 11 01:06:36.086762 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386879 2572 flags.go:64] FLAG: --max-pods="110" Jul 11 01:06:36.086762 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386882 2572 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 11 01:06:36.086762 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386885 2572 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 11 01:06:36.086762 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386888 2572 flags.go:64] FLAG: --memory-manager-policy="None" Jul 11 01:06:36.086762 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386890 2572 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 11 01:06:36.086762 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386893 2572 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 11 01:06:36.086762 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386910 2572 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 11 01:06:36.086762 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386914 2572 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 11 01:06:36.086762 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386920 2572 flags.go:64] FLAG: --node-status-max-images="50" Jul 11 01:06:36.086762 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386924 2572 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 11 01:06:36.086762 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386927 2572 flags.go:64] FLAG: --oom-score-adj="-999" Jul 11 01:06:36.086762 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386930 2572 flags.go:64] FLAG: --pod-cidr="" Jul 11 01:06:36.086762 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386933 2572 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 11 01:06:36.087955 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386940 2572 flags.go:64] FLAG: --pod-manifest-path="" Jul 11 01:06:36.087955 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386943 2572 flags.go:64] FLAG: --pod-max-pids="-1" Jul 11 01:06:36.087955 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386946 2572 flags.go:64] FLAG: --pods-per-core="0" Jul 11 01:06:36.087955 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386948 2572 flags.go:64] FLAG: --port="10250" Jul 11 01:06:36.087955 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386951 2572 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 11 01:06:36.087955 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386954 2572 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-033f635647f675f11" Jul 11 01:06:36.087955 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386957 2572 flags.go:64] FLAG: --qos-reserved="" Jul 11 01:06:36.087955 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386960 2572 flags.go:64] FLAG: --read-only-port="10255" Jul 11 01:06:36.087955 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386963 2572 flags.go:64] FLAG: --register-node="true" Jul 11 01:06:36.087955 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386966 2572 flags.go:64] FLAG: --register-with-taints="" Jul 11 01:06:36.087955 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386969 2572 flags.go:64] FLAG: --registry-burst="10" Jul 11 01:06:36.087955 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386972 2572 flags.go:64] FLAG: --registry-qps="5" Jul 11 01:06:36.087955 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386975 2572 flags.go:64] FLAG: --reserved-cpus="" Jul 11 01:06:36.087955 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386978 2572 flags.go:64] FLAG: --reserved-memory="" Jul 11 01:06:36.087955 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386983 2572 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 11 01:06:36.087955 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386986 2572 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 11 01:06:36.087955 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386990 2572 flags.go:64] FLAG: --rotate-certificates="false" Jul 11 01:06:36.087955 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386993 2572 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 11 01:06:36.087955 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386996 2572 flags.go:64] FLAG: --runonce="false" Jul 11 01:06:36.087955 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.386999 2572 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 11 01:06:36.087955 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.387002 2572 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 11 01:06:36.087955 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.387005 2572 flags.go:64] FLAG: --seccomp-default="false" Jul 11 01:06:36.087955 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.387008 2572 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 11 01:06:36.087955 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.387011 2572 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 11 01:06:36.087955 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.387014 2572 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 11 01:06:36.087955 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.387017 2572 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 11 01:06:36.089336 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.387020 2572 flags.go:64] FLAG: --storage-driver-password="root" Jul 11 01:06:36.089336 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.387023 2572 flags.go:64] FLAG: --storage-driver-secure="false" Jul 11 01:06:36.089336 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.387026 2572 flags.go:64] FLAG: --storage-driver-table="stats" Jul 11 01:06:36.089336 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.387028 2572 flags.go:64] FLAG: --storage-driver-user="root" Jul 11 01:06:36.089336 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.387031 2572 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 11 01:06:36.089336 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.387034 2572 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 11 01:06:36.089336 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.387039 2572 flags.go:64] FLAG: --system-cgroups="" Jul 11 01:06:36.089336 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.387041 2572 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 11 01:06:36.089336 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.387046 2572 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 11 01:06:36.089336 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.387049 2572 flags.go:64] FLAG: --tls-cert-file="" Jul 11 01:06:36.089336 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.387052 2572 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 11 01:06:36.089336 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.387059 2572 flags.go:64] FLAG: --tls-min-version="" Jul 11 01:06:36.089336 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.387061 2572 flags.go:64] FLAG: --tls-private-key-file="" Jul 11 01:06:36.089336 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.387064 2572 flags.go:64] FLAG: --topology-manager-policy="none" Jul 11 01:06:36.089336 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.387067 2572 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 11 01:06:36.089336 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.387070 2572 flags.go:64] FLAG: --topology-manager-scope="container" Jul 11 01:06:36.089336 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.387073 2572 flags.go:64] FLAG: --v="2" Jul 11 01:06:36.089336 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.387076 2572 flags.go:64] FLAG: --version="false" Jul 11 01:06:36.089336 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.387081 2572 flags.go:64] FLAG: --vmodule="" Jul 11 01:06:36.089336 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.387085 2572 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 11 01:06:36.089336 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.387089 2572 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 11 01:06:36.089336 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387204 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 11 01:06:36.089336 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387209 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 11 01:06:36.089336 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387212 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 11 01:06:36.286926 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387215 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 11 01:06:36.286926 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387217 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 11 01:06:36.286926 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387220 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 11 01:06:36.286926 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387223 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 11 01:06:36.286926 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387226 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 11 01:06:36.286926 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387228 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 11 01:06:36.286926 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387231 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 11 01:06:36.286926 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387235 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 11 01:06:36.286926 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387238 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 11 01:06:36.286926 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387241 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 11 01:06:36.286926 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387245 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 11 01:06:36.286926 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387249 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 11 01:06:36.286926 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387252 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 11 01:06:36.286926 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387254 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 11 01:06:36.286926 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387257 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 11 01:06:36.286926 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387263 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 11 01:06:36.286926 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387266 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 11 01:06:36.286926 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387269 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 11 01:06:36.286926 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387271 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 11 01:06:36.310688 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387274 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 11 01:06:36.310688 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387276 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 11 01:06:36.310688 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387279 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 11 01:06:36.310688 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387282 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 11 01:06:36.310688 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387285 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 11 01:06:36.310688 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387287 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 11 01:06:36.310688 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387290 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 11 01:06:36.310688 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387292 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 11 01:06:36.310688 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387295 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 11 01:06:36.310688 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387298 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 11 01:06:36.310688 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387301 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 11 01:06:36.310688 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387305 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 11 01:06:36.310688 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387309 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 11 01:06:36.310688 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387313 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 11 01:06:36.310688 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387316 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 11 01:06:36.310688 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387319 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 11 01:06:36.310688 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387321 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 11 01:06:36.310688 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387324 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 11 01:06:36.310688 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387327 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 11 01:06:36.312118 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387330 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 11 01:06:36.312118 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387332 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 11 01:06:36.312118 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387335 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 11 01:06:36.312118 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387338 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 11 01:06:36.312118 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387340 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 11 01:06:36.312118 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387343 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 11 01:06:36.312118 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387345 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 11 01:06:36.312118 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387348 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 11 01:06:36.312118 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387351 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 11 01:06:36.312118 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387353 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 11 01:06:36.312118 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387356 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 11 01:06:36.312118 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387359 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 11 01:06:36.312118 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387361 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 11 01:06:36.312118 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387364 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 11 01:06:36.312118 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387366 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 11 01:06:36.312118 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387369 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 11 01:06:36.312118 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387371 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 11 01:06:36.312118 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387374 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 11 01:06:36.312118 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387376 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 11 01:06:36.312118 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387379 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 11 01:06:36.313239 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387381 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 11 01:06:36.313239 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387384 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 11 01:06:36.313239 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387388 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 11 01:06:36.313239 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387391 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 11 01:06:36.313239 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387394 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 11 01:06:36.313239 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387397 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 11 01:06:36.313239 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387399 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 11 01:06:36.313239 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387402 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 11 01:06:36.313239 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387405 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 11 01:06:36.313239 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387407 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 11 01:06:36.313239 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387410 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 11 01:06:36.313239 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387412 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 11 01:06:36.313239 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387415 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 11 01:06:36.313239 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387418 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 11 01:06:36.313239 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387420 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 11 01:06:36.313239 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387422 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 11 01:06:36.313239 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387425 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 11 01:06:36.313239 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387428 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 11 01:06:36.313239 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387430 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 11 01:06:36.313239 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387433 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 11 01:06:36.318158 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387435 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 11 01:06:36.318158 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387438 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 11 01:06:36.318158 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387440 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 11 01:06:36.318158 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387443 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 11 01:06:36.318158 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387446 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 11 01:06:36.318158 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387448 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 11 01:06:36.318158 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387451 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 11 01:06:36.318158 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387453 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 11 01:06:36.318158 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387456 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 11 01:06:36.318158 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387458 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 11 01:06:36.318158 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387461 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 11 01:06:36.318158 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387464 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 11 01:06:36.318158 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387466 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 11 01:06:36.318158 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387468 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 11 01:06:36.318158 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387472 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 11 01:06:36.318158 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387475 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 11 01:06:36.318158 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387478 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 11 01:06:36.318158 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.387481 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 11 01:06:36.319026 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.388108 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 11 01:06:36.319026 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.397522 2572 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 11 01:06:36.319026 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.397537 2572 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 11 01:06:36.319026 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.397550 2572 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 11 01:06:36.319026 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.397563 2572 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 11 01:06:36.319026 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397657 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 11 01:06:36.319026 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397663 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 11 01:06:36.319026 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397666 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 11 01:06:36.319026 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397670 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 11 01:06:36.319026 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397673 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 11 01:06:36.319026 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397676 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 11 01:06:36.319026 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397682 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 11 01:06:36.319026 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397685 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 11 01:06:36.319026 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397688 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 11 01:06:36.319026 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397691 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 11 01:06:36.320495 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397694 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 11 01:06:36.320495 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397697 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 11 01:06:36.320495 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397701 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 11 01:06:36.320495 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397704 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 11 01:06:36.320495 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397707 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 11 01:06:36.320495 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397710 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 11 01:06:36.320495 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397713 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 11 01:06:36.320495 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397715 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 11 01:06:36.320495 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397721 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 11 01:06:36.320495 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397725 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 11 01:06:36.320495 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397729 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 11 01:06:36.320495 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397732 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 11 01:06:36.320495 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397735 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 11 01:06:36.320495 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397738 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 11 01:06:36.320495 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397741 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 11 01:06:36.320495 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397744 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 11 01:06:36.320495 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397746 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 11 01:06:36.320495 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397749 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 11 01:06:36.320495 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397752 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 11 01:06:36.321381 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397755 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 11 01:06:36.321381 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397758 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 11 01:06:36.321381 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397763 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 11 01:06:36.321381 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397770 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 11 01:06:36.321381 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397773 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 11 01:06:36.321381 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397776 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 11 01:06:36.321381 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397778 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 11 01:06:36.321381 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397781 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 11 01:06:36.321381 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397784 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 11 01:06:36.321381 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397787 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 11 01:06:36.321381 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397790 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 11 01:06:36.321381 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397793 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 11 01:06:36.321381 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397796 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 11 01:06:36.321381 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397798 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 11 01:06:36.321381 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397804 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 11 01:06:36.321381 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397806 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 11 01:06:36.321381 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397809 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 11 01:06:36.321381 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397812 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 11 01:06:36.321381 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397815 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 11 01:06:36.321381 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397819 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 11 01:06:36.322657 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397822 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 11 01:06:36.322657 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397836 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 11 01:06:36.322657 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397839 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 11 01:06:36.322657 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397842 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 11 01:06:36.322657 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397846 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 11 01:06:36.322657 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397849 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 11 01:06:36.322657 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397852 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 11 01:06:36.322657 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397858 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 11 01:06:36.322657 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397860 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 11 01:06:36.322657 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397863 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 11 01:06:36.322657 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397866 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 11 01:06:36.322657 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397868 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 11 01:06:36.322657 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397871 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 11 01:06:36.322657 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397874 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 11 01:06:36.322657 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397878 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 11 01:06:36.322657 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397882 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 11 01:06:36.322657 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397885 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 11 01:06:36.322657 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397888 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 11 01:06:36.322657 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397891 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 11 01:06:36.322657 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397911 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 11 01:06:36.327325 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397917 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 11 01:06:36.327325 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397922 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 11 01:06:36.327325 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397925 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 11 01:06:36.327325 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397928 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 11 01:06:36.327325 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397930 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 11 01:06:36.327325 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397933 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 11 01:06:36.327325 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397936 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 11 01:06:36.327325 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397939 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 11 01:06:36.327325 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397942 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 11 01:06:36.327325 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397945 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 11 01:06:36.327325 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397948 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 11 01:06:36.327325 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397954 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 11 01:06:36.327325 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397957 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 11 01:06:36.327325 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397960 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 11 01:06:36.327325 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397962 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 11 01:06:36.327325 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397965 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 11 01:06:36.327325 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397970 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 11 01:06:36.327325 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397974 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 11 01:06:36.327325 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397977 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 11 01:06:36.328197 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397980 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 11 01:06:36.328197 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397983 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 11 01:06:36.328197 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397986 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 11 01:06:36.328197 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397989 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 11 01:06:36.328197 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397992 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 11 01:06:36.328197 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.397998 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 11 01:06:36.328197 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398001 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 11 01:06:36.328197 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398004 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 11 01:06:36.328197 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398008 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 11 01:06:36.328197 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398011 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 11 01:06:36.328197 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398014 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 11 01:06:36.328197 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.398019 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 11 01:06:36.328197 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398246 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 11 01:06:36.328197 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398370 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 11 01:06:36.328197 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398386 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 11 01:06:36.329083 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398390 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 11 01:06:36.329083 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398393 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 11 01:06:36.329083 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398396 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 11 01:06:36.329083 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398399 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 11 01:06:36.329083 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398402 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 11 01:06:36.329083 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398405 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 11 01:06:36.329083 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398408 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 11 01:06:36.329083 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398414 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 11 01:06:36.329083 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398422 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 11 01:06:36.329083 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398425 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 11 01:06:36.329083 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398428 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 11 01:06:36.329083 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398431 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 11 01:06:36.329083 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398434 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 11 01:06:36.329083 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398436 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 11 01:06:36.329083 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398439 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 11 01:06:36.329083 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398444 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 11 01:06:36.329083 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398450 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 11 01:06:36.329083 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398454 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 11 01:06:36.329083 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398459 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 11 01:06:36.330594 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398463 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 11 01:06:36.330594 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398466 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 11 01:06:36.330594 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398469 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 11 01:06:36.330594 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398472 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 11 01:06:36.330594 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398475 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 11 01:06:36.330594 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398478 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 11 01:06:36.330594 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398481 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 11 01:06:36.330594 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398483 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 11 01:06:36.330594 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398486 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 11 01:06:36.330594 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398490 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 11 01:06:36.330594 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398492 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 11 01:06:36.330594 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398495 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 11 01:06:36.330594 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398498 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 11 01:06:36.330594 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398501 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 11 01:06:36.330594 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398504 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 11 01:06:36.330594 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398507 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 11 01:06:36.330594 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398510 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 11 01:06:36.330594 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398513 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 11 01:06:36.330594 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398516 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 11 01:06:36.330594 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398519 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 11 01:06:36.331471 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398523 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 11 01:06:36.331471 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398526 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 11 01:06:36.331471 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398528 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 11 01:06:36.331471 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398531 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 11 01:06:36.331471 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398534 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 11 01:06:36.331471 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398538 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 11 01:06:36.331471 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398541 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 11 01:06:36.331471 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398546 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 11 01:06:36.331471 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398550 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 11 01:06:36.331471 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398553 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 11 01:06:36.331471 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398557 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 11 01:06:36.331471 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398561 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 11 01:06:36.331471 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398564 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 11 01:06:36.331471 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398567 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 11 01:06:36.331471 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398570 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 11 01:06:36.331471 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398573 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 11 01:06:36.331471 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398575 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 11 01:06:36.331471 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398578 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 11 01:06:36.331471 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398580 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 11 01:06:36.332346 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398585 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 11 01:06:36.332346 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398588 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 11 01:06:36.332346 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398591 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 11 01:06:36.332346 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398593 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 11 01:06:36.332346 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398596 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 11 01:06:36.332346 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398598 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 11 01:06:36.332346 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398601 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 11 01:06:36.332346 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398603 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 11 01:06:36.332346 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398606 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 11 01:06:36.332346 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398608 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 11 01:06:36.332346 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398611 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 11 01:06:36.332346 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398614 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 11 01:06:36.332346 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398616 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 11 01:06:36.332346 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398620 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 11 01:06:36.332346 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398623 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 11 01:06:36.332346 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398626 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 11 01:06:36.332346 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398629 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 11 01:06:36.332346 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398631 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 11 01:06:36.332346 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398634 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 11 01:06:36.332346 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398636 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 11 01:06:36.334513 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398639 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 11 01:06:36.334513 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398641 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 11 01:06:36.334513 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398644 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 11 01:06:36.334513 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398646 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 11 01:06:36.334513 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398649 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 11 01:06:36.334513 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398652 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 11 01:06:36.334513 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398654 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 11 01:06:36.334513 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398657 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 11 01:06:36.334513 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398659 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 11 01:06:36.334513 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398662 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 11 01:06:36.334513 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398665 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 11 01:06:36.334513 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398668 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 11 01:06:36.334513 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398671 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 11 01:06:36.334513 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398674 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 11 01:06:36.334513 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398677 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 11 01:06:36.334513 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398679 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 11 01:06:36.334513 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398682 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 11 01:06:36.334513 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:34.398684 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 11 01:06:36.335388 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.398690 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 11 01:06:36.335388 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.398805 2572 server.go:962] "Client rotation is on, will bootstrap in background" Jul 11 01:06:36.335388 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.400888 2572 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 11 01:06:36.335388 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.402375 2572 server.go:1019] "Starting client certificate rotation" Jul 11 01:06:36.335388 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.402470 2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 11 01:06:36.335388 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.402501 2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 11 01:06:36.335388 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.405071 2572 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 11 01:06:36.335388 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.406242 2572 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 11 01:06:36.335388 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.420272 2572 log.go:25] "Validated CRI v1 runtime API" Jul 11 01:06:36.335388 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.422576 2572 log.go:25] "Validated CRI v1 image API" Jul 11 01:06:36.335388 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.423324 2572 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 11 01:06:36.335388 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.425744 2572 fs.go:135] Filesystem UUIDs: map[6c554516-4245-4a52-a425-e96679852ac2:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 7c3c1362-7c7b-4351-8047-de741f21f958:/dev/nvme0n1p3] Jul 11 01:06:36.491086 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.425761 2572 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 11 01:06:36.491086 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.430254 2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 11 01:06:36.492355 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.430680 2572 manager.go:216] Machine: {Timestamp:2026-07-11 01:06:34.429347485 +0000 UTC m=+0.366622148 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3095437 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2060b936e1324f2be6881e40d80c5e SystemUUID:ec2060b9-36e1-324f-2be6-881e40d80c5e BootID:c3f55fbe-3eed-4413-9b00-6aadeae404d4 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:8d:65:c8:ea:f7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:8d:65:c8:ea:f7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b6:f2:27:03:18:a4 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 11 01:06:36.492355 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.430783 2572 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 11 01:06:36.492355 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.430867 2572 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 11 01:06:36.492355 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.434280 2572 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 11 01:06:36.492355 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.434304 2572 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-161.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 11 01:06:36.492355 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.434938 2572 topology_manager.go:138] "Creating topology manager with none policy" Jul 11 01:06:36.492355 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.434947 2572 container_manager_linux.go:309] "Creating device plugin manager" Jul 11 01:06:36.492355 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.434955 2572 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 11 01:06:36.492355 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.435823 2572 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 11 01:06:36.492355 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.436527 2572 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 11 01:06:36.492355 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.440409 2572 state_mem.go:36] "Initialized new in-memory state store" Jul 11 01:06:36.492355 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.440520 2572 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 11 01:06:36.492355 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.440547 2572 kubelet.go:486] "Attempting to sync node with API server" Jul 11 01:06:36.492355 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.440555 2572 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 11 01:06:36.492355 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.440569 2572 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 11 01:06:36.492355 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.440578 2572 kubelet.go:398] "Adding apiserver pod source" Jul 11 01:06:36.492355 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.440586 2572 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 11 01:06:36.492355 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.440980 2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 11 01:06:36.492999 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.441008 2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 11 01:06:36.492999 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.443291 2572 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 11 01:06:36.492999 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.447250 2572 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 11 01:06:36.492999 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.447293 2572 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 11 01:06:36.492999 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.447958 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 11 01:06:36.492999 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.447977 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 11 01:06:36.492999 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.447987 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 11 01:06:36.492999 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.447995 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 11 01:06:36.492999 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.448007 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 11 01:06:36.492999 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.448015 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 11 01:06:36.492999 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.448554 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 11 01:06:36.492999 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.448570 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 11 01:06:36.492999 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.448587 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 11 01:06:36.492999 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.448596 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 11 01:06:36.492999 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.448608 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 11 01:06:36.492999 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.448621 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 11 01:06:36.492999 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.450353 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 11 01:06:36.492999 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.450376 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 11 01:06:36.492999 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.452662 2572 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-161.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 11 01:06:36.492999 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.452700 2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2jg85" Jul 11 01:06:36.492999 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:34.452717 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 11 01:06:36.492999 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:34.452767 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-161.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 11 01:06:36.492999 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.454179 2572 server.go:1268] "Started kubelet" Jul 11 01:06:36.492999 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.454252 2572 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 11 01:06:36.492999 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.454263 2572 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 11 01:06:36.492999 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.454321 2572 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 11 01:06:36.492999 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.455333 2572 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 11 01:06:36.492999 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.455656 2572 server.go:310] "Adding debug handlers to kubelet server" Jul 11 01:06:36.492999 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:34.459565 2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2jg85" Jul 11 01:06:36.492999 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:34.460410 2572 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 11 01:06:36.492999 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:34.461249 2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-161.ec2.internal.18c116cc5ff05465 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-161.ec2.internal,UID:ip-10-0-138-161.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-161.ec2.internal,},FirstTimestamp:2026-07-11 01:06:34.454152293 +0000 UTC m=+0.391426935,LastTimestamp:2026-07-11 01:06:34.454152293 +0000 UTC m=+0.391426935,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-161.ec2.internal,}" Jul 11 01:06:36.492999 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.070591 2572 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 11 01:06:36.492999 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.070601 2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 11 01:06:36.492999 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:36.070676 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-161.ec2.internal\" not found" Jul 11 01:06:36.492999 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.071235 2572 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 11 01:06:36.492999 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.071248 2572 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 11 01:06:36.492999 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.071266 2572 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 11 01:06:36.492999 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.071544 2572 reconstruct.go:97] "Volume reconstruction finished" Jul 11 01:06:36.492999 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.071553 2572 reconciler.go:29] "Reconciler: start to sync state" Jul 11 01:06:36.492999 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.071679 2572 factory.go:153] Registering CRI-O factory Jul 11 01:06:36.494064 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.071689 2572 factory.go:223] Registration of the crio container factory successfully Jul 11 01:06:36.494064 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.071780 2572 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 11 01:06:36.494064 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.071790 2572 factory.go:55] Registering systemd factory Jul 11 01:06:36.494064 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.071798 2572 factory.go:223] Registration of the systemd container factory successfully Jul 11 01:06:36.494064 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.071818 2572 factory.go:103] Registering Raw factory Jul 11 01:06:36.494064 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.071832 2572 manager.go:1196] Started watching for new ooms in manager Jul 11 01:06:36.494064 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.073021 2572 manager.go:349] Starting recovery of all containers Jul 11 01:06:36.494064 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:36.073928 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 11 01:06:36.494064 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:36.073968 2572 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-161.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 11 01:06:36.494064 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.086836 2572 manager.go:354] Recovery completed Jul 11 01:06:36.494064 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.092097 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 11 01:06:36.494064 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.094268 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-161.ec2.internal" event="NodeHasSufficientMemory" Jul 11 01:06:36.494064 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.094294 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-161.ec2.internal" event="NodeHasNoDiskPressure" Jul 11 01:06:36.494064 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.094303 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-161.ec2.internal" event="NodeHasSufficientPID" Jul 11 01:06:36.494064 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.094801 2572 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 11 01:06:36.494064 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.094810 2572 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 11 01:06:36.494064 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.094825 2572 state_mem.go:36] "Initialized new in-memory state store" Jul 11 01:06:36.494064 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.094848 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 11 01:06:36.494064 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.096712 2572 policy_none.go:49] "None policy: Start" Jul 11 01:06:36.494064 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.096728 2572 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 11 01:06:36.494064 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.096740 2572 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 11 01:06:36.494064 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.098598 2572 policy_none.go:47] "Start" Jul 11 01:06:36.494064 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.100320 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-161.ec2.internal" event="NodeHasSufficientMemory" Jul 11 01:06:36.494064 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.100348 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-161.ec2.internal" event="NodeHasNoDiskPressure" Jul 11 01:06:36.494064 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.100359 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-161.ec2.internal" event="NodeHasSufficientPID" Jul 11 01:06:36.494064 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.144564 2572 manager.go:337] "Starting Device Plugin manager" Jul 11 01:06:36.494064 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:36.144598 2572 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 11 01:06:36.494064 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.144607 2572 server.go:87] "Starting device plugin registration server" Jul 11 01:06:36.494064 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.144865 2572 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 11 01:06:36.494064 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.144874 2572 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 11 01:06:36.494064 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.145157 2572 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 11 01:06:36.494064 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.145254 2572 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 11 01:06:36.494064 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.145265 2572 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 11 01:06:36.494064 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:36.145922 2572 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 11 01:06:36.494064 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:36.145972 2572 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-161.ec2.internal\" not found" Jul 11 01:06:36.494064 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.246130 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 11 01:06:36.494064 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.247265 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-161.ec2.internal" event="NodeHasSufficientMemory" Jul 11 01:06:36.494064 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.247294 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-161.ec2.internal" event="NodeHasNoDiskPressure" Jul 11 01:06:36.494064 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.247304 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-161.ec2.internal" event="NodeHasSufficientPID" Jul 11 01:06:36.494064 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.247330 2572 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-161.ec2.internal" Jul 11 01:06:36.494064 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.249259 2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 11 01:06:36.494064 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.250602 2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 11 01:06:36.494064 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.250634 2572 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 11 01:06:36.494064 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.250653 2572 kubelet.go:2448] "Starting kubelet main sync loop" Jul 11 01:06:36.494064 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:36.250683 2572 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 11 01:06:36.494064 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.253389 2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 11 01:06:36.494064 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.254905 2572 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-161.ec2.internal" Jul 11 01:06:36.495351 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:36.254934 2572 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-161.ec2.internal\": node \"ip-10-0-138-161.ec2.internal\" not found" Jul 11 01:06:36.495351 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:36.292949 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-161.ec2.internal\" not found" Jul 11 01:06:36.495351 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.351055 2572 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-161.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-161.ec2.internal"] Jul 11 01:06:36.495351 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.351174 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 11 01:06:36.495351 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.353795 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-161.ec2.internal" event="NodeHasSufficientMemory" Jul 11 01:06:36.495351 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.353822 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-161.ec2.internal" event="NodeHasNoDiskPressure" Jul 11 01:06:36.495351 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.353831 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-161.ec2.internal" event="NodeHasSufficientPID" Jul 11 01:06:36.495351 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.356063 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 11 01:06:36.495351 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.356172 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-161.ec2.internal" Jul 11 01:06:36.495351 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.356213 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 11 01:06:36.495351 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.358064 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-161.ec2.internal" event="NodeHasSufficientMemory" Jul 11 01:06:36.495351 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.358082 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-161.ec2.internal" event="NodeHasNoDiskPressure" Jul 11 01:06:36.495351 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.358091 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-161.ec2.internal" event="NodeHasSufficientPID" Jul 11 01:06:36.495351 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.358066 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-161.ec2.internal" event="NodeHasSufficientMemory" Jul 11 01:06:36.495351 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.358132 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-161.ec2.internal" event="NodeHasNoDiskPressure" Jul 11 01:06:36.495351 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.358145 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-161.ec2.internal" event="NodeHasSufficientPID" Jul 11 01:06:36.495351 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.360428 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-161.ec2.internal" Jul 11 01:06:36.495351 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.360457 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 11 01:06:36.495351 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.361513 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-161.ec2.internal" event="NodeHasSufficientMemory" Jul 11 01:06:36.495351 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.361533 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-161.ec2.internal" event="NodeHasNoDiskPressure" Jul 11 01:06:36.495351 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.361542 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-161.ec2.internal" event="NodeHasSufficientPID" Jul 11 01:06:36.495351 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:36.393375 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-161.ec2.internal\" not found" Jul 11 01:06:36.495351 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:36.394000 2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-161.ec2.internal\" not found" node="ip-10-0-138-161.ec2.internal" Jul 11 01:06:36.495351 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:36.398673 2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-161.ec2.internal\" not found" node="ip-10-0-138-161.ec2.internal" Jul 11 01:06:36.495351 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.473163 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7d6d27db974b8b86e3da7428c71f54c4-config\") pod \"kube-apiserver-proxy-ip-10-0-138-161.ec2.internal\" (UID: \"7d6d27db974b8b86e3da7428c71f54c4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-161.ec2.internal" Jul 11 01:06:36.495351 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.473199 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ddc18782af4676c4d2733345c70ab795-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-161.ec2.internal\" (UID: \"ddc18782af4676c4d2733345c70ab795\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-161.ec2.internal" Jul 11 01:06:36.495351 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.473224 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ddc18782af4676c4d2733345c70ab795-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-161.ec2.internal\" (UID: \"ddc18782af4676c4d2733345c70ab795\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-161.ec2.internal" Jul 11 01:06:36.495351 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:36.494228 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-161.ec2.internal\" not found" Jul 11 01:06:36.678868 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.573920 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ddc18782af4676c4d2733345c70ab795-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-161.ec2.internal\" (UID: \"ddc18782af4676c4d2733345c70ab795\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-161.ec2.internal" Jul 11 01:06:36.678868 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.573950 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ddc18782af4676c4d2733345c70ab795-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-161.ec2.internal\" (UID: \"ddc18782af4676c4d2733345c70ab795\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-161.ec2.internal" Jul 11 01:06:36.678868 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.573968 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7d6d27db974b8b86e3da7428c71f54c4-config\") pod \"kube-apiserver-proxy-ip-10-0-138-161.ec2.internal\" (UID: \"7d6d27db974b8b86e3da7428c71f54c4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-161.ec2.internal" Jul 11 01:06:36.678868 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.574000 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ddc18782af4676c4d2733345c70ab795-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-161.ec2.internal\" (UID: \"ddc18782af4676c4d2733345c70ab795\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-161.ec2.internal" Jul 11 01:06:36.678868 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.574009 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ddc18782af4676c4d2733345c70ab795-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-161.ec2.internal\" (UID: \"ddc18782af4676c4d2733345c70ab795\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-161.ec2.internal" Jul 11 01:06:36.678868 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.574048 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7d6d27db974b8b86e3da7428c71f54c4-config\") pod \"kube-apiserver-proxy-ip-10-0-138-161.ec2.internal\" (UID: \"7d6d27db974b8b86e3da7428c71f54c4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-161.ec2.internal" Jul 11 01:06:36.678868 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:36.595023 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-161.ec2.internal\" not found" Jul 11 01:06:36.858785 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:36.695532 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-161.ec2.internal\" not found" Jul 11 01:06:36.858785 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.696636 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-161.ec2.internal" Jul 11 01:06:36.858785 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.701367 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-161.ec2.internal" Jul 11 01:06:36.858785 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:36.796462 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-161.ec2.internal\" not found" Jul 11 01:06:37.033866 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:36.896882 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-161.ec2.internal\" not found" Jul 11 01:06:37.033866 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.930232 2572 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 11 01:06:37.033866 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.971138 2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-161.ec2.internal" Jul 11 01:06:37.033866 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.986962 2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 11 01:06:37.033866 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.988733 2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-161.ec2.internal" Jul 11 01:06:37.033866 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:36.997074 2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 11 01:06:37.033866 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.007897 2572 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 11 01:06:37.033866 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.008025 2572 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 11 01:06:37.033866 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.008064 2572 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 11 01:06:37.196178 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.051952 2572 apiserver.go:52] "Watching apiserver" Jul 11 01:06:37.196178 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.068650 2572 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 11 01:06:37.196178 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.069893 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-f6sd8","kube-system/kube-apiserver-proxy-ip-10-0-138-161.ec2.internal","openshift-multus/multus-additional-cni-plugins-tlq4c","openshift-network-diagnostics/network-check-target-m82rx","openshift-network-operator/iptables-alerter-t2ztp","openshift-ovn-kubernetes/ovnkube-node-hww5x","kube-system/global-pull-secret-syncer-vmt4r","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-457jl","openshift-cluster-node-tuning-operator/tuned-b5t7g","openshift-dns/node-resolver-jjd8d","openshift-image-registry/node-ca-46bl6","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-161.ec2.internal","openshift-multus/multus-ff2g5","openshift-multus/network-metrics-daemon-4j8b6"] Jul 11 01:06:37.196178 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.071431 2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 11 01:06:37.196178 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.072555 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-f6sd8" Jul 11 01:06:37.196178 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.072720 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-10 01:01:36 +0000 UTC" deadline="2028-04-07 23:44:15.957354444 +0000 UTC" Jul 11 01:06:37.196178 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.072746 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15286h37m38.884611515s" Jul 11 01:06:37.196178 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.075213 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 11 01:06:37.196178 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.075312 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-4826t\"" Jul 11 01:06:37.196178 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.075414 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 11 01:06:37.196178 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.075584 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tlq4c" Jul 11 01:06:37.196178 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.077507 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/80e2a675-663f-4959-89d2-c97483b65e4c-agent-certs\") pod \"konnectivity-agent-f6sd8\" (UID: \"80e2a675-663f-4959-89d2-c97483b65e4c\") " pod="kube-system/konnectivity-agent-f6sd8" Jul 11 01:06:37.196178 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.077555 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/80e2a675-663f-4959-89d2-c97483b65e4c-konnectivity-ca\") pod \"konnectivity-agent-f6sd8\" (UID: \"80e2a675-663f-4959-89d2-c97483b65e4c\") " pod="kube-system/konnectivity-agent-f6sd8" Jul 11 01:06:37.196178 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.077926 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m82rx" Jul 11 01:06:37.196178 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:37.078263 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m82rx" podUID="95087320-8e0c-484c-b734-3360faeff948" Jul 11 01:06:37.196178 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.079086 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 11 01:06:37.196178 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.079477 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 11 01:06:37.196178 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.079489 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 11 01:06:37.196178 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.079499 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 11 01:06:37.196178 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.080610 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-t2ztp" Jul 11 01:06:37.196178 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.081208 2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 11 01:06:37.196178 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.081344 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 11 01:06:37.196178 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.081383 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-2zs79\"" Jul 11 01:06:37.196178 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.083031 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hww5x" Jul 11 01:06:37.196178 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.083200 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 11 01:06:37.196178 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.083296 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 11 01:06:37.196178 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.083412 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-6hl4q\"" Jul 11 01:06:37.196178 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.083425 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 11 01:06:37.196178 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.085110 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmt4r" Jul 11 01:06:37.198327 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:37.085160 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vmt4r" podUID="99a7e6d5-7736-4a0e-b4c2-12f925deb1b2" Jul 11 01:06:37.198327 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.085369 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 11 01:06:37.198327 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.085378 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 11 01:06:37.198327 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.085416 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 11 01:06:37.198327 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.085439 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 11 01:06:37.198327 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.085636 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-h7h8z\"" Jul 11 01:06:37.198327 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.085636 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 11 01:06:37.198327 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.085791 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 11 01:06:37.198327 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.087915 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-457jl" Jul 11 01:06:37.198327 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.090336 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 11 01:06:37.198327 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.090575 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 11 01:06:37.198327 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.090588 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 11 01:06:37.198327 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.090619 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-p9hbf\"" Jul 11 01:06:37.198327 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.090666 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-b5t7g" Jul 11 01:06:37.198327 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.092992 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 11 01:06:37.198327 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.093184 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7j592\"" Jul 11 01:06:37.198327 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.093411 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 11 01:06:37.198327 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.094334 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jjd8d" Jul 11 01:06:37.198327 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.096614 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-46bl6" Jul 11 01:06:37.198327 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.096656 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 11 01:06:37.198327 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.096834 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-mqhg2\"" Jul 11 01:06:37.198327 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.096900 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 11 01:06:37.198327 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.098963 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 11 01:06:37.198327 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.099074 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ff2g5" Jul 11 01:06:37.198327 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.099366 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 11 01:06:37.198327 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.099367 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 11 01:06:37.198327 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.099370 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-wdfx6\"" Jul 11 01:06:37.198327 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.099890 2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-27lph" Jul 11 01:06:37.198327 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.101386 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-v7w8h\"" Jul 11 01:06:37.198327 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.101711 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 11 01:06:37.198327 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.101824 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4j8b6" Jul 11 01:06:37.198327 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:37.101881 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4j8b6" podUID="6de25e6a-b433-4f08-941a-9666d215fe54" Jul 11 01:06:37.198327 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.105930 2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-27lph" Jul 11 01:06:37.198327 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.173027 2572 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 11 01:06:37.199802 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.177880 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/db99d519-c8a2-40f5-b238-123774baa78a-cnibin\") pod \"multus-ff2g5\" (UID: \"db99d519-c8a2-40f5-b238-123774baa78a\") " pod="openshift-multus/multus-ff2g5" Jul 11 01:06:37.199802 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.177905 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/db99d519-c8a2-40f5-b238-123774baa78a-host-var-lib-kubelet\") pod \"multus-ff2g5\" (UID: \"db99d519-c8a2-40f5-b238-123774baa78a\") " pod="openshift-multus/multus-ff2g5" Jul 11 01:06:37.199802 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.177923 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a817a6e0-4aaa-40d0-95f4-5daeb4481842-system-cni-dir\") pod \"multus-additional-cni-plugins-tlq4c\" (UID: \"a817a6e0-4aaa-40d0-95f4-5daeb4481842\") " pod="openshift-multus/multus-additional-cni-plugins-tlq4c" Jul 11 01:06:37.199802 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.177939 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bc650005-4617-49c3-a87c-ccd4c5d14b6f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hww5x\" (UID: \"bc650005-4617-49c3-a87c-ccd4c5d14b6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hww5x" Jul 11 01:06:37.199802 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.177956 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/78a7b886-157e-4df7-9599-c86dfb672085-host\") pod \"tuned-b5t7g\" (UID: \"78a7b886-157e-4df7-9599-c86dfb672085\") " pod="openshift-cluster-node-tuning-operator/tuned-b5t7g" Jul 11 01:06:37.199802 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.177994 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfkqm\" (UniqueName: \"kubernetes.io/projected/78a7b886-157e-4df7-9599-c86dfb672085-kube-api-access-nfkqm\") pod \"tuned-b5t7g\" (UID: \"78a7b886-157e-4df7-9599-c86dfb672085\") " pod="openshift-cluster-node-tuning-operator/tuned-b5t7g" Jul 11 01:06:37.199802 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.178022 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bc650005-4617-49c3-a87c-ccd4c5d14b6f-run-ovn\") pod \"ovnkube-node-hww5x\" (UID: \"bc650005-4617-49c3-a87c-ccd4c5d14b6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hww5x" Jul 11 01:06:37.199802 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.178048 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/78a7b886-157e-4df7-9599-c86dfb672085-etc-sysctl-d\") pod \"tuned-b5t7g\" (UID: \"78a7b886-157e-4df7-9599-c86dfb672085\") " pod="openshift-cluster-node-tuning-operator/tuned-b5t7g" Jul 11 01:06:37.199802 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.178076 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/78a7b886-157e-4df7-9599-c86dfb672085-lib-modules\") pod \"tuned-b5t7g\" (UID: \"78a7b886-157e-4df7-9599-c86dfb672085\") " pod="openshift-cluster-node-tuning-operator/tuned-b5t7g" Jul 11 01:06:37.199802 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.178104 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/db99d519-c8a2-40f5-b238-123774baa78a-multus-cni-dir\") pod \"multus-ff2g5\" (UID: \"db99d519-c8a2-40f5-b238-123774baa78a\") " pod="openshift-multus/multus-ff2g5" Jul 11 01:06:37.199802 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.178130 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a817a6e0-4aaa-40d0-95f4-5daeb4481842-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tlq4c\" (UID: \"a817a6e0-4aaa-40d0-95f4-5daeb4481842\") " pod="openshift-multus/multus-additional-cni-plugins-tlq4c" Jul 11 01:06:37.199802 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.178149 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5d4af8ec-f681-4671-939b-db461fb0dc06-host-slash\") pod \"iptables-alerter-t2ztp\" (UID: \"5d4af8ec-f681-4671-939b-db461fb0dc06\") " pod="openshift-network-operator/iptables-alerter-t2ztp" Jul 11 01:06:37.199802 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.178164 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/db99d519-c8a2-40f5-b238-123774baa78a-cni-binary-copy\") pod \"multus-ff2g5\" (UID: \"db99d519-c8a2-40f5-b238-123774baa78a\") " pod="openshift-multus/multus-ff2g5" Jul 11 01:06:37.199802 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.178184 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mmk5\" (UniqueName: \"kubernetes.io/projected/db99d519-c8a2-40f5-b238-123774baa78a-kube-api-access-4mmk5\") pod \"multus-ff2g5\" (UID: \"db99d519-c8a2-40f5-b238-123774baa78a\") " pod="openshift-multus/multus-ff2g5" Jul 11 01:06:37.199802 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.178216 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4f51f053-17f3-44cc-8b0e-0ca541b7370e-registration-dir\") pod \"aws-ebs-csi-driver-node-457jl\" (UID: \"4f51f053-17f3-44cc-8b0e-0ca541b7370e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-457jl" Jul 11 01:06:37.199802 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.178233 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/78a7b886-157e-4df7-9599-c86dfb672085-etc-systemd\") pod \"tuned-b5t7g\" (UID: \"78a7b886-157e-4df7-9599-c86dfb672085\") " pod="openshift-cluster-node-tuning-operator/tuned-b5t7g" Jul 11 01:06:37.200586 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.178263 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ec166c39-ac6d-4182-a8d6-fb0a34eb1915-serviceca\") pod \"node-ca-46bl6\" (UID: \"ec166c39-ac6d-4182-a8d6-fb0a34eb1915\") " pod="openshift-image-registry/node-ca-46bl6" Jul 11 01:06:37.200586 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.178328 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/db99d519-c8a2-40f5-b238-123774baa78a-host-var-lib-cni-multus\") pod \"multus-ff2g5\" (UID: \"db99d519-c8a2-40f5-b238-123774baa78a\") " pod="openshift-multus/multus-ff2g5" Jul 11 01:06:37.200586 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.178359 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/78a7b886-157e-4df7-9599-c86dfb672085-etc-kubernetes\") pod \"tuned-b5t7g\" (UID: \"78a7b886-157e-4df7-9599-c86dfb672085\") " pod="openshift-cluster-node-tuning-operator/tuned-b5t7g" Jul 11 01:06:37.200586 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.178380 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/78a7b886-157e-4df7-9599-c86dfb672085-var-lib-kubelet\") pod \"tuned-b5t7g\" (UID: \"78a7b886-157e-4df7-9599-c86dfb672085\") " pod="openshift-cluster-node-tuning-operator/tuned-b5t7g" Jul 11 01:06:37.200586 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.178396 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpmml\" (UniqueName: \"kubernetes.io/projected/a817a6e0-4aaa-40d0-95f4-5daeb4481842-kube-api-access-lpmml\") pod \"multus-additional-cni-plugins-tlq4c\" (UID: \"a817a6e0-4aaa-40d0-95f4-5daeb4481842\") " pod="openshift-multus/multus-additional-cni-plugins-tlq4c" Jul 11 01:06:37.200586 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.178413 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bc650005-4617-49c3-a87c-ccd4c5d14b6f-systemd-units\") pod \"ovnkube-node-hww5x\" (UID: \"bc650005-4617-49c3-a87c-ccd4c5d14b6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hww5x" Jul 11 01:06:37.200586 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.178427 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bc650005-4617-49c3-a87c-ccd4c5d14b6f-host-slash\") pod \"ovnkube-node-hww5x\" (UID: \"bc650005-4617-49c3-a87c-ccd4c5d14b6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hww5x" Jul 11 01:06:37.200586 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.178441 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bc650005-4617-49c3-a87c-ccd4c5d14b6f-ovnkube-script-lib\") pod \"ovnkube-node-hww5x\" (UID: \"bc650005-4617-49c3-a87c-ccd4c5d14b6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hww5x" Jul 11 01:06:37.200586 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.178456 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4f51f053-17f3-44cc-8b0e-0ca541b7370e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-457jl\" (UID: \"4f51f053-17f3-44cc-8b0e-0ca541b7370e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-457jl" Jul 11 01:06:37.200586 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.178469 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4f51f053-17f3-44cc-8b0e-0ca541b7370e-sys-fs\") pod \"aws-ebs-csi-driver-node-457jl\" (UID: \"4f51f053-17f3-44cc-8b0e-0ca541b7370e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-457jl" Jul 11 01:06:37.200586 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.178482 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/78a7b886-157e-4df7-9599-c86dfb672085-tmp\") pod \"tuned-b5t7g\" (UID: \"78a7b886-157e-4df7-9599-c86dfb672085\") " pod="openshift-cluster-node-tuning-operator/tuned-b5t7g" Jul 11 01:06:37.200586 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.178497 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/db99d519-c8a2-40f5-b238-123774baa78a-hostroot\") pod \"multus-ff2g5\" (UID: \"db99d519-c8a2-40f5-b238-123774baa78a\") " pod="openshift-multus/multus-ff2g5" Jul 11 01:06:37.200586 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.178510 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/db99d519-c8a2-40f5-b238-123774baa78a-host-run-multus-certs\") pod \"multus-ff2g5\" (UID: \"db99d519-c8a2-40f5-b238-123774baa78a\") " pod="openshift-multus/multus-ff2g5" Jul 11 01:06:37.200586 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.178525 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfl99\" (UniqueName: \"kubernetes.io/projected/95087320-8e0c-484c-b734-3360faeff948-kube-api-access-nfl99\") pod \"network-check-target-m82rx\" (UID: \"95087320-8e0c-484c-b734-3360faeff948\") " pod="openshift-network-diagnostics/network-check-target-m82rx" Jul 11 01:06:37.200586 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.178540 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/78a7b886-157e-4df7-9599-c86dfb672085-etc-sysctl-conf\") pod \"tuned-b5t7g\" (UID: \"78a7b886-157e-4df7-9599-c86dfb672085\") " pod="openshift-cluster-node-tuning-operator/tuned-b5t7g" Jul 11 01:06:37.200586 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.178554 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/db99d519-c8a2-40f5-b238-123774baa78a-system-cni-dir\") pod \"multus-ff2g5\" (UID: \"db99d519-c8a2-40f5-b238-123774baa78a\") " pod="openshift-multus/multus-ff2g5" Jul 11 01:06:37.201207 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.178571 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/80e2a675-663f-4959-89d2-c97483b65e4c-agent-certs\") pod \"konnectivity-agent-f6sd8\" (UID: \"80e2a675-663f-4959-89d2-c97483b65e4c\") " pod="kube-system/konnectivity-agent-f6sd8" Jul 11 01:06:37.201207 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.178609 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bc650005-4617-49c3-a87c-ccd4c5d14b6f-ovnkube-config\") pod \"ovnkube-node-hww5x\" (UID: \"bc650005-4617-49c3-a87c-ccd4c5d14b6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hww5x" Jul 11 01:06:37.201207 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.178677 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7494d\" (UniqueName: \"kubernetes.io/projected/bc650005-4617-49c3-a87c-ccd4c5d14b6f-kube-api-access-7494d\") pod \"ovnkube-node-hww5x\" (UID: \"bc650005-4617-49c3-a87c-ccd4c5d14b6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hww5x" Jul 11 01:06:37.201207 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.178723 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/99a7e6d5-7736-4a0e-b4c2-12f925deb1b2-dbus\") pod \"global-pull-secret-syncer-vmt4r\" (UID: \"99a7e6d5-7736-4a0e-b4c2-12f925deb1b2\") " pod="kube-system/global-pull-secret-syncer-vmt4r" Jul 11 01:06:37.201207 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.178746 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4f51f053-17f3-44cc-8b0e-0ca541b7370e-device-dir\") pod \"aws-ebs-csi-driver-node-457jl\" (UID: \"4f51f053-17f3-44cc-8b0e-0ca541b7370e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-457jl" Jul 11 01:06:37.201207 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.178766 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxvnr\" (UniqueName: \"kubernetes.io/projected/5d4af8ec-f681-4671-939b-db461fb0dc06-kube-api-access-pxvnr\") pod \"iptables-alerter-t2ztp\" (UID: \"5d4af8ec-f681-4671-939b-db461fb0dc06\") " pod="openshift-network-operator/iptables-alerter-t2ztp" Jul 11 01:06:37.201207 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.178787 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/db99d519-c8a2-40f5-b238-123774baa78a-host-run-netns\") pod \"multus-ff2g5\" (UID: \"db99d519-c8a2-40f5-b238-123774baa78a\") " pod="openshift-multus/multus-ff2g5" Jul 11 01:06:37.201207 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.178806 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a817a6e0-4aaa-40d0-95f4-5daeb4481842-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tlq4c\" (UID: \"a817a6e0-4aaa-40d0-95f4-5daeb4481842\") " pod="openshift-multus/multus-additional-cni-plugins-tlq4c" Jul 11 01:06:37.201207 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.178828 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bc650005-4617-49c3-a87c-ccd4c5d14b6f-run-openvswitch\") pod \"ovnkube-node-hww5x\" (UID: \"bc650005-4617-49c3-a87c-ccd4c5d14b6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hww5x" Jul 11 01:06:37.201207 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.178848 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bc650005-4617-49c3-a87c-ccd4c5d14b6f-log-socket\") pod \"ovnkube-node-hww5x\" (UID: \"bc650005-4617-49c3-a87c-ccd4c5d14b6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hww5x" Jul 11 01:06:37.201207 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.178866 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bc650005-4617-49c3-a87c-ccd4c5d14b6f-host-run-ovn-kubernetes\") pod \"ovnkube-node-hww5x\" (UID: \"bc650005-4617-49c3-a87c-ccd4c5d14b6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hww5x" Jul 11 01:06:37.201207 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.178885 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bc650005-4617-49c3-a87c-ccd4c5d14b6f-host-cni-bin\") pod \"ovnkube-node-hww5x\" (UID: \"bc650005-4617-49c3-a87c-ccd4c5d14b6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hww5x" Jul 11 01:06:37.201207 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.178918 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/99a7e6d5-7736-4a0e-b4c2-12f925deb1b2-original-pull-secret\") pod \"global-pull-secret-syncer-vmt4r\" (UID: \"99a7e6d5-7736-4a0e-b4c2-12f925deb1b2\") " pod="kube-system/global-pull-secret-syncer-vmt4r" Jul 11 01:06:37.201207 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.178950 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/db99d519-c8a2-40f5-b238-123774baa78a-multus-socket-dir-parent\") pod \"multus-ff2g5\" (UID: \"db99d519-c8a2-40f5-b238-123774baa78a\") " pod="openshift-multus/multus-ff2g5" Jul 11 01:06:37.201207 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.178947 2572 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 11 01:06:37.201207 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.178992 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/db99d519-c8a2-40f5-b238-123774baa78a-host-run-k8s-cni-cncf-io\") pod \"multus-ff2g5\" (UID: \"db99d519-c8a2-40f5-b238-123774baa78a\") " pod="openshift-multus/multus-ff2g5" Jul 11 01:06:37.201207 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.179021 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a817a6e0-4aaa-40d0-95f4-5daeb4481842-os-release\") pod \"multus-additional-cni-plugins-tlq4c\" (UID: \"a817a6e0-4aaa-40d0-95f4-5daeb4481842\") " pod="openshift-multus/multus-additional-cni-plugins-tlq4c" Jul 11 01:06:37.201998 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.179074 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bc650005-4617-49c3-a87c-ccd4c5d14b6f-host-run-netns\") pod \"ovnkube-node-hww5x\" (UID: \"bc650005-4617-49c3-a87c-ccd4c5d14b6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hww5x" Jul 11 01:06:37.201998 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.179101 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bc650005-4617-49c3-a87c-ccd4c5d14b6f-host-cni-netd\") pod \"ovnkube-node-hww5x\" (UID: \"bc650005-4617-49c3-a87c-ccd4c5d14b6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hww5x" Jul 11 01:06:37.201998 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.179121 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6de25e6a-b433-4f08-941a-9666d215fe54-metrics-certs\") pod \"network-metrics-daemon-4j8b6\" (UID: \"6de25e6a-b433-4f08-941a-9666d215fe54\") " pod="openshift-multus/network-metrics-daemon-4j8b6" Jul 11 01:06:37.201998 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.179146 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gx8d\" (UniqueName: \"kubernetes.io/projected/6de25e6a-b433-4f08-941a-9666d215fe54-kube-api-access-6gx8d\") pod \"network-metrics-daemon-4j8b6\" (UID: \"6de25e6a-b433-4f08-941a-9666d215fe54\") " pod="openshift-multus/network-metrics-daemon-4j8b6" Jul 11 01:06:37.201998 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.179173 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/db99d519-c8a2-40f5-b238-123774baa78a-multus-conf-dir\") pod \"multus-ff2g5\" (UID: \"db99d519-c8a2-40f5-b238-123774baa78a\") " pod="openshift-multus/multus-ff2g5" Jul 11 01:06:37.201998 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.179196 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/db99d519-c8a2-40f5-b238-123774baa78a-multus-daemon-config\") pod \"multus-ff2g5\" (UID: \"db99d519-c8a2-40f5-b238-123774baa78a\") " pod="openshift-multus/multus-ff2g5" Jul 11 01:06:37.201998 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.179216 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db99d519-c8a2-40f5-b238-123774baa78a-etc-kubernetes\") pod \"multus-ff2g5\" (UID: \"db99d519-c8a2-40f5-b238-123774baa78a\") " pod="openshift-multus/multus-ff2g5" Jul 11 01:06:37.201998 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.179246 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a817a6e0-4aaa-40d0-95f4-5daeb4481842-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tlq4c\" (UID: \"a817a6e0-4aaa-40d0-95f4-5daeb4481842\") " pod="openshift-multus/multus-additional-cni-plugins-tlq4c" Jul 11 01:06:37.201998 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.179283 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bc650005-4617-49c3-a87c-ccd4c5d14b6f-run-systemd\") pod \"ovnkube-node-hww5x\" (UID: \"bc650005-4617-49c3-a87c-ccd4c5d14b6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hww5x" Jul 11 01:06:37.201998 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.179315 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4f51f053-17f3-44cc-8b0e-0ca541b7370e-socket-dir\") pod \"aws-ebs-csi-driver-node-457jl\" (UID: \"4f51f053-17f3-44cc-8b0e-0ca541b7370e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-457jl" Jul 11 01:06:37.201998 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.179338 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/78a7b886-157e-4df7-9599-c86dfb672085-run\") pod \"tuned-b5t7g\" (UID: \"78a7b886-157e-4df7-9599-c86dfb672085\") " pod="openshift-cluster-node-tuning-operator/tuned-b5t7g" Jul 11 01:06:37.201998 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.179354 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/db99d519-c8a2-40f5-b238-123774baa78a-host-var-lib-cni-bin\") pod \"multus-ff2g5\" (UID: \"db99d519-c8a2-40f5-b238-123774baa78a\") " pod="openshift-multus/multus-ff2g5" Jul 11 01:06:37.201998 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.179377 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a817a6e0-4aaa-40d0-95f4-5daeb4481842-cni-binary-copy\") pod \"multus-additional-cni-plugins-tlq4c\" (UID: \"a817a6e0-4aaa-40d0-95f4-5daeb4481842\") " pod="openshift-multus/multus-additional-cni-plugins-tlq4c" Jul 11 01:06:37.201998 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.179410 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bc650005-4617-49c3-a87c-ccd4c5d14b6f-host-kubelet\") pod \"ovnkube-node-hww5x\" (UID: \"bc650005-4617-49c3-a87c-ccd4c5d14b6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hww5x" Jul 11 01:06:37.201998 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.179437 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bc650005-4617-49c3-a87c-ccd4c5d14b6f-etc-openvswitch\") pod \"ovnkube-node-hww5x\" (UID: \"bc650005-4617-49c3-a87c-ccd4c5d14b6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hww5x" Jul 11 01:06:37.201998 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.179459 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bc650005-4617-49c3-a87c-ccd4c5d14b6f-node-log\") pod \"ovnkube-node-hww5x\" (UID: \"bc650005-4617-49c3-a87c-ccd4c5d14b6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hww5x" Jul 11 01:06:37.202748 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.179480 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5kgr\" (UniqueName: \"kubernetes.io/projected/4f51f053-17f3-44cc-8b0e-0ca541b7370e-kube-api-access-n5kgr\") pod \"aws-ebs-csi-driver-node-457jl\" (UID: \"4f51f053-17f3-44cc-8b0e-0ca541b7370e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-457jl" Jul 11 01:06:37.202748 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.179503 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/db99d519-c8a2-40f5-b238-123774baa78a-os-release\") pod \"multus-ff2g5\" (UID: \"db99d519-c8a2-40f5-b238-123774baa78a\") " pod="openshift-multus/multus-ff2g5" Jul 11 01:06:37.202748 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.179542 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bc650005-4617-49c3-a87c-ccd4c5d14b6f-var-lib-openvswitch\") pod \"ovnkube-node-hww5x\" (UID: \"bc650005-4617-49c3-a87c-ccd4c5d14b6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hww5x" Jul 11 01:06:37.202748 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.179558 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bc650005-4617-49c3-a87c-ccd4c5d14b6f-ovn-node-metrics-cert\") pod \"ovnkube-node-hww5x\" (UID: \"bc650005-4617-49c3-a87c-ccd4c5d14b6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hww5x" Jul 11 01:06:37.202748 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.179571 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4f51f053-17f3-44cc-8b0e-0ca541b7370e-etc-selinux\") pod \"aws-ebs-csi-driver-node-457jl\" (UID: \"4f51f053-17f3-44cc-8b0e-0ca541b7370e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-457jl" Jul 11 01:06:37.202748 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.179595 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e1e3c11c-1b4f-4101-8df4-2e9f1d13a67c-hosts-file\") pod \"node-resolver-jjd8d\" (UID: \"e1e3c11c-1b4f-4101-8df4-2e9f1d13a67c\") " pod="openshift-dns/node-resolver-jjd8d" Jul 11 01:06:37.202748 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.179612 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/78a7b886-157e-4df7-9599-c86dfb672085-sys\") pod \"tuned-b5t7g\" (UID: \"78a7b886-157e-4df7-9599-c86dfb672085\") " pod="openshift-cluster-node-tuning-operator/tuned-b5t7g" Jul 11 01:06:37.202748 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.179626 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsjfw\" (UniqueName: \"kubernetes.io/projected/ec166c39-ac6d-4182-a8d6-fb0a34eb1915-kube-api-access-jsjfw\") pod \"node-ca-46bl6\" (UID: \"ec166c39-ac6d-4182-a8d6-fb0a34eb1915\") " pod="openshift-image-registry/node-ca-46bl6" Jul 11 01:06:37.202748 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.179645 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a817a6e0-4aaa-40d0-95f4-5daeb4481842-cnibin\") pod \"multus-additional-cni-plugins-tlq4c\" (UID: \"a817a6e0-4aaa-40d0-95f4-5daeb4481842\") " pod="openshift-multus/multus-additional-cni-plugins-tlq4c" Jul 11 01:06:37.202748 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.179664 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/80e2a675-663f-4959-89d2-c97483b65e4c-konnectivity-ca\") pod \"konnectivity-agent-f6sd8\" (UID: \"80e2a675-663f-4959-89d2-c97483b65e4c\") " pod="kube-system/konnectivity-agent-f6sd8" Jul 11 01:06:37.202748 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.179691 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/99a7e6d5-7736-4a0e-b4c2-12f925deb1b2-kubelet-config\") pod \"global-pull-secret-syncer-vmt4r\" (UID: \"99a7e6d5-7736-4a0e-b4c2-12f925deb1b2\") " pod="kube-system/global-pull-secret-syncer-vmt4r" Jul 11 01:06:37.202748 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.179731 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sb2t9\" (UniqueName: \"kubernetes.io/projected/e1e3c11c-1b4f-4101-8df4-2e9f1d13a67c-kube-api-access-sb2t9\") pod \"node-resolver-jjd8d\" (UID: \"e1e3c11c-1b4f-4101-8df4-2e9f1d13a67c\") " pod="openshift-dns/node-resolver-jjd8d" Jul 11 01:06:37.202748 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.179746 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5d4af8ec-f681-4671-939b-db461fb0dc06-iptables-alerter-script\") pod \"iptables-alerter-t2ztp\" (UID: \"5d4af8ec-f681-4671-939b-db461fb0dc06\") " pod="openshift-network-operator/iptables-alerter-t2ztp" Jul 11 01:06:37.202748 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.179760 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/78a7b886-157e-4df7-9599-c86dfb672085-etc-modprobe-d\") pod \"tuned-b5t7g\" (UID: \"78a7b886-157e-4df7-9599-c86dfb672085\") " pod="openshift-cluster-node-tuning-operator/tuned-b5t7g" Jul 11 01:06:37.202748 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.179776 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/78a7b886-157e-4df7-9599-c86dfb672085-etc-sysconfig\") pod \"tuned-b5t7g\" (UID: \"78a7b886-157e-4df7-9599-c86dfb672085\") " pod="openshift-cluster-node-tuning-operator/tuned-b5t7g" Jul 11 01:06:37.202748 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.179797 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/78a7b886-157e-4df7-9599-c86dfb672085-etc-tuned\") pod \"tuned-b5t7g\" (UID: \"78a7b886-157e-4df7-9599-c86dfb672085\") " pod="openshift-cluster-node-tuning-operator/tuned-b5t7g" Jul 11 01:06:37.205109 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.179816 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bc650005-4617-49c3-a87c-ccd4c5d14b6f-env-overrides\") pod \"ovnkube-node-hww5x\" (UID: \"bc650005-4617-49c3-a87c-ccd4c5d14b6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hww5x" Jul 11 01:06:37.205109 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.179829 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e1e3c11c-1b4f-4101-8df4-2e9f1d13a67c-tmp-dir\") pod \"node-resolver-jjd8d\" (UID: \"e1e3c11c-1b4f-4101-8df4-2e9f1d13a67c\") " pod="openshift-dns/node-resolver-jjd8d" Jul 11 01:06:37.205109 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.179843 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ec166c39-ac6d-4182-a8d6-fb0a34eb1915-host\") pod \"node-ca-46bl6\" (UID: \"ec166c39-ac6d-4182-a8d6-fb0a34eb1915\") " pod="openshift-image-registry/node-ca-46bl6" Jul 11 01:06:37.205109 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.180128 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/80e2a675-663f-4959-89d2-c97483b65e4c-konnectivity-ca\") pod \"konnectivity-agent-f6sd8\" (UID: \"80e2a675-663f-4959-89d2-c97483b65e4c\") " pod="kube-system/konnectivity-agent-f6sd8" Jul 11 01:06:37.205109 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.182018 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/80e2a675-663f-4959-89d2-c97483b65e4c-agent-certs\") pod \"konnectivity-agent-f6sd8\" (UID: \"80e2a675-663f-4959-89d2-c97483b65e4c\") " pod="kube-system/konnectivity-agent-f6sd8" Jul 11 01:06:37.337766 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.280812 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/db99d519-c8a2-40f5-b238-123774baa78a-multus-conf-dir\") pod \"multus-ff2g5\" (UID: \"db99d519-c8a2-40f5-b238-123774baa78a\") " pod="openshift-multus/multus-ff2g5" Jul 11 01:06:37.337766 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.280837 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/db99d519-c8a2-40f5-b238-123774baa78a-multus-daemon-config\") pod \"multus-ff2g5\" (UID: \"db99d519-c8a2-40f5-b238-123774baa78a\") " pod="openshift-multus/multus-ff2g5" Jul 11 01:06:37.337766 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.280856 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db99d519-c8a2-40f5-b238-123774baa78a-etc-kubernetes\") pod \"multus-ff2g5\" (UID: \"db99d519-c8a2-40f5-b238-123774baa78a\") " pod="openshift-multus/multus-ff2g5" Jul 11 01:06:37.337766 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.280876 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a817a6e0-4aaa-40d0-95f4-5daeb4481842-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tlq4c\" (UID: \"a817a6e0-4aaa-40d0-95f4-5daeb4481842\") " pod="openshift-multus/multus-additional-cni-plugins-tlq4c" Jul 11 01:06:37.337766 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.280893 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bc650005-4617-49c3-a87c-ccd4c5d14b6f-run-systemd\") pod \"ovnkube-node-hww5x\" (UID: \"bc650005-4617-49c3-a87c-ccd4c5d14b6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hww5x" Jul 11 01:06:37.337766 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.280926 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4f51f053-17f3-44cc-8b0e-0ca541b7370e-socket-dir\") pod \"aws-ebs-csi-driver-node-457jl\" (UID: \"4f51f053-17f3-44cc-8b0e-0ca541b7370e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-457jl" Jul 11 01:06:37.337766 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.280926 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/db99d519-c8a2-40f5-b238-123774baa78a-multus-conf-dir\") pod \"multus-ff2g5\" (UID: \"db99d519-c8a2-40f5-b238-123774baa78a\") " pod="openshift-multus/multus-ff2g5" Jul 11 01:06:37.337766 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.280941 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db99d519-c8a2-40f5-b238-123774baa78a-etc-kubernetes\") pod \"multus-ff2g5\" (UID: \"db99d519-c8a2-40f5-b238-123774baa78a\") " pod="openshift-multus/multus-ff2g5" Jul 11 01:06:37.337766 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.280961 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bc650005-4617-49c3-a87c-ccd4c5d14b6f-run-systemd\") pod \"ovnkube-node-hww5x\" (UID: \"bc650005-4617-49c3-a87c-ccd4c5d14b6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hww5x" Jul 11 01:06:37.337766 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.280984 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/78a7b886-157e-4df7-9599-c86dfb672085-run\") pod \"tuned-b5t7g\" (UID: \"78a7b886-157e-4df7-9599-c86dfb672085\") " pod="openshift-cluster-node-tuning-operator/tuned-b5t7g" Jul 11 01:06:37.337766 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.281065 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/db99d519-c8a2-40f5-b238-123774baa78a-host-var-lib-cni-bin\") pod \"multus-ff2g5\" (UID: \"db99d519-c8a2-40f5-b238-123774baa78a\") " pod="openshift-multus/multus-ff2g5" Jul 11 01:06:37.337766 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.281091 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/78a7b886-157e-4df7-9599-c86dfb672085-run\") pod \"tuned-b5t7g\" (UID: \"78a7b886-157e-4df7-9599-c86dfb672085\") " pod="openshift-cluster-node-tuning-operator/tuned-b5t7g" Jul 11 01:06:37.337766 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.281107 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4f51f053-17f3-44cc-8b0e-0ca541b7370e-socket-dir\") pod \"aws-ebs-csi-driver-node-457jl\" (UID: \"4f51f053-17f3-44cc-8b0e-0ca541b7370e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-457jl" Jul 11 01:06:37.337766 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.281144 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a817a6e0-4aaa-40d0-95f4-5daeb4481842-cni-binary-copy\") pod \"multus-additional-cni-plugins-tlq4c\" (UID: \"a817a6e0-4aaa-40d0-95f4-5daeb4481842\") " pod="openshift-multus/multus-additional-cni-plugins-tlq4c" Jul 11 01:06:37.337766 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.281445 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/db99d519-c8a2-40f5-b238-123774baa78a-host-var-lib-cni-bin\") pod \"multus-ff2g5\" (UID: \"db99d519-c8a2-40f5-b238-123774baa78a\") " pod="openshift-multus/multus-ff2g5" Jul 11 01:06:37.337766 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.281526 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bc650005-4617-49c3-a87c-ccd4c5d14b6f-host-kubelet\") pod \"ovnkube-node-hww5x\" (UID: \"bc650005-4617-49c3-a87c-ccd4c5d14b6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hww5x" Jul 11 01:06:37.337766 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.281569 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bc650005-4617-49c3-a87c-ccd4c5d14b6f-etc-openvswitch\") pod \"ovnkube-node-hww5x\" (UID: \"bc650005-4617-49c3-a87c-ccd4c5d14b6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hww5x" Jul 11 01:06:37.337766 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.281639 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/db99d519-c8a2-40f5-b238-123774baa78a-multus-daemon-config\") pod \"multus-ff2g5\" (UID: \"db99d519-c8a2-40f5-b238-123774baa78a\") " pod="openshift-multus/multus-ff2g5" Jul 11 01:06:37.339584 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.281671 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bc650005-4617-49c3-a87c-ccd4c5d14b6f-etc-openvswitch\") pod \"ovnkube-node-hww5x\" (UID: \"bc650005-4617-49c3-a87c-ccd4c5d14b6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hww5x" Jul 11 01:06:37.339584 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.281728 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bc650005-4617-49c3-a87c-ccd4c5d14b6f-host-kubelet\") pod \"ovnkube-node-hww5x\" (UID: \"bc650005-4617-49c3-a87c-ccd4c5d14b6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hww5x" Jul 11 01:06:37.339584 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.281741 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bc650005-4617-49c3-a87c-ccd4c5d14b6f-node-log\") pod \"ovnkube-node-hww5x\" (UID: \"bc650005-4617-49c3-a87c-ccd4c5d14b6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hww5x" Jul 11 01:06:37.339584 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.281776 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5kgr\" (UniqueName: \"kubernetes.io/projected/4f51f053-17f3-44cc-8b0e-0ca541b7370e-kube-api-access-n5kgr\") pod \"aws-ebs-csi-driver-node-457jl\" (UID: \"4f51f053-17f3-44cc-8b0e-0ca541b7370e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-457jl" Jul 11 01:06:37.339584 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.281803 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a817a6e0-4aaa-40d0-95f4-5daeb4481842-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tlq4c\" (UID: \"a817a6e0-4aaa-40d0-95f4-5daeb4481842\") " pod="openshift-multus/multus-additional-cni-plugins-tlq4c" Jul 11 01:06:37.339584 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.281871 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/db99d519-c8a2-40f5-b238-123774baa78a-os-release\") pod \"multus-ff2g5\" (UID: \"db99d519-c8a2-40f5-b238-123774baa78a\") " pod="openshift-multus/multus-ff2g5" Jul 11 01:06:37.339584 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.281807 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/db99d519-c8a2-40f5-b238-123774baa78a-os-release\") pod \"multus-ff2g5\" (UID: \"db99d519-c8a2-40f5-b238-123774baa78a\") " pod="openshift-multus/multus-ff2g5" Jul 11 01:06:37.339584 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.281935 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bc650005-4617-49c3-a87c-ccd4c5d14b6f-var-lib-openvswitch\") pod \"ovnkube-node-hww5x\" (UID: \"bc650005-4617-49c3-a87c-ccd4c5d14b6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hww5x" Jul 11 01:06:37.339584 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.281963 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bc650005-4617-49c3-a87c-ccd4c5d14b6f-ovn-node-metrics-cert\") pod \"ovnkube-node-hww5x\" (UID: \"bc650005-4617-49c3-a87c-ccd4c5d14b6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hww5x" Jul 11 01:06:37.339584 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.281807 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bc650005-4617-49c3-a87c-ccd4c5d14b6f-node-log\") pod \"ovnkube-node-hww5x\" (UID: \"bc650005-4617-49c3-a87c-ccd4c5d14b6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hww5x" Jul 11 01:06:37.339584 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.282010 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4f51f053-17f3-44cc-8b0e-0ca541b7370e-etc-selinux\") pod \"aws-ebs-csi-driver-node-457jl\" (UID: \"4f51f053-17f3-44cc-8b0e-0ca541b7370e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-457jl" Jul 11 01:06:37.339584 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.282045 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e1e3c11c-1b4f-4101-8df4-2e9f1d13a67c-hosts-file\") pod \"node-resolver-jjd8d\" (UID: \"e1e3c11c-1b4f-4101-8df4-2e9f1d13a67c\") " pod="openshift-dns/node-resolver-jjd8d" Jul 11 01:06:37.339584 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.282084 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bc650005-4617-49c3-a87c-ccd4c5d14b6f-var-lib-openvswitch\") pod \"ovnkube-node-hww5x\" (UID: \"bc650005-4617-49c3-a87c-ccd4c5d14b6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hww5x" Jul 11 01:06:37.339584 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.282122 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a817a6e0-4aaa-40d0-95f4-5daeb4481842-cni-binary-copy\") pod \"multus-additional-cni-plugins-tlq4c\" (UID: \"a817a6e0-4aaa-40d0-95f4-5daeb4481842\") " pod="openshift-multus/multus-additional-cni-plugins-tlq4c" Jul 11 01:06:37.339584 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.282077 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/78a7b886-157e-4df7-9599-c86dfb672085-sys\") pod \"tuned-b5t7g\" (UID: \"78a7b886-157e-4df7-9599-c86dfb672085\") " pod="openshift-cluster-node-tuning-operator/tuned-b5t7g" Jul 11 01:06:37.339584 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.282208 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsjfw\" (UniqueName: \"kubernetes.io/projected/ec166c39-ac6d-4182-a8d6-fb0a34eb1915-kube-api-access-jsjfw\") pod \"node-ca-46bl6\" (UID: \"ec166c39-ac6d-4182-a8d6-fb0a34eb1915\") " pod="openshift-image-registry/node-ca-46bl6" Jul 11 01:06:37.339584 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.282235 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a817a6e0-4aaa-40d0-95f4-5daeb4481842-cnibin\") pod \"multus-additional-cni-plugins-tlq4c\" (UID: \"a817a6e0-4aaa-40d0-95f4-5daeb4481842\") " pod="openshift-multus/multus-additional-cni-plugins-tlq4c" Jul 11 01:06:37.342021 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.282269 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/99a7e6d5-7736-4a0e-b4c2-12f925deb1b2-kubelet-config\") pod \"global-pull-secret-syncer-vmt4r\" (UID: \"99a7e6d5-7736-4a0e-b4c2-12f925deb1b2\") " pod="kube-system/global-pull-secret-syncer-vmt4r" Jul 11 01:06:37.342021 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.282209 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e1e3c11c-1b4f-4101-8df4-2e9f1d13a67c-hosts-file\") pod \"node-resolver-jjd8d\" (UID: \"e1e3c11c-1b4f-4101-8df4-2e9f1d13a67c\") " pod="openshift-dns/node-resolver-jjd8d" Jul 11 01:06:37.342021 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.282318 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4f51f053-17f3-44cc-8b0e-0ca541b7370e-etc-selinux\") pod \"aws-ebs-csi-driver-node-457jl\" (UID: \"4f51f053-17f3-44cc-8b0e-0ca541b7370e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-457jl" Jul 11 01:06:37.342021 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.282388 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a817a6e0-4aaa-40d0-95f4-5daeb4481842-cnibin\") pod \"multus-additional-cni-plugins-tlq4c\" (UID: \"a817a6e0-4aaa-40d0-95f4-5daeb4481842\") " pod="openshift-multus/multus-additional-cni-plugins-tlq4c" Jul 11 01:06:37.342021 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.282299 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sb2t9\" (UniqueName: \"kubernetes.io/projected/e1e3c11c-1b4f-4101-8df4-2e9f1d13a67c-kube-api-access-sb2t9\") pod \"node-resolver-jjd8d\" (UID: \"e1e3c11c-1b4f-4101-8df4-2e9f1d13a67c\") " pod="openshift-dns/node-resolver-jjd8d" Jul 11 01:06:37.342021 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.282434 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5d4af8ec-f681-4671-939b-db461fb0dc06-iptables-alerter-script\") pod \"iptables-alerter-t2ztp\" (UID: \"5d4af8ec-f681-4671-939b-db461fb0dc06\") " pod="openshift-network-operator/iptables-alerter-t2ztp" Jul 11 01:06:37.342021 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.282488 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/78a7b886-157e-4df7-9599-c86dfb672085-etc-modprobe-d\") pod \"tuned-b5t7g\" (UID: \"78a7b886-157e-4df7-9599-c86dfb672085\") " pod="openshift-cluster-node-tuning-operator/tuned-b5t7g" Jul 11 01:06:37.342021 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.282514 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/78a7b886-157e-4df7-9599-c86dfb672085-etc-sysconfig\") pod \"tuned-b5t7g\" (UID: \"78a7b886-157e-4df7-9599-c86dfb672085\") " pod="openshift-cluster-node-tuning-operator/tuned-b5t7g" Jul 11 01:06:37.342021 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.282543 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/78a7b886-157e-4df7-9599-c86dfb672085-etc-tuned\") pod \"tuned-b5t7g\" (UID: \"78a7b886-157e-4df7-9599-c86dfb672085\") " pod="openshift-cluster-node-tuning-operator/tuned-b5t7g" Jul 11 01:06:37.342021 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.282572 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bc650005-4617-49c3-a87c-ccd4c5d14b6f-env-overrides\") pod \"ovnkube-node-hww5x\" (UID: \"bc650005-4617-49c3-a87c-ccd4c5d14b6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hww5x" Jul 11 01:06:37.342021 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.282750 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e1e3c11c-1b4f-4101-8df4-2e9f1d13a67c-tmp-dir\") pod \"node-resolver-jjd8d\" (UID: \"e1e3c11c-1b4f-4101-8df4-2e9f1d13a67c\") " pod="openshift-dns/node-resolver-jjd8d" Jul 11 01:06:37.342021 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.282789 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ec166c39-ac6d-4182-a8d6-fb0a34eb1915-host\") pod \"node-ca-46bl6\" (UID: \"ec166c39-ac6d-4182-a8d6-fb0a34eb1915\") " pod="openshift-image-registry/node-ca-46bl6" Jul 11 01:06:37.342021 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.282823 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/db99d519-c8a2-40f5-b238-123774baa78a-cnibin\") pod \"multus-ff2g5\" (UID: \"db99d519-c8a2-40f5-b238-123774baa78a\") " pod="openshift-multus/multus-ff2g5" Jul 11 01:06:37.342021 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.282834 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/78a7b886-157e-4df7-9599-c86dfb672085-etc-modprobe-d\") pod \"tuned-b5t7g\" (UID: \"78a7b886-157e-4df7-9599-c86dfb672085\") " pod="openshift-cluster-node-tuning-operator/tuned-b5t7g" Jul 11 01:06:37.342021 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.282855 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/db99d519-c8a2-40f5-b238-123774baa78a-host-var-lib-kubelet\") pod \"multus-ff2g5\" (UID: \"db99d519-c8a2-40f5-b238-123774baa78a\") " pod="openshift-multus/multus-ff2g5" Jul 11 01:06:37.342021 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.282913 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/99a7e6d5-7736-4a0e-b4c2-12f925deb1b2-kubelet-config\") pod \"global-pull-secret-syncer-vmt4r\" (UID: \"99a7e6d5-7736-4a0e-b4c2-12f925deb1b2\") " pod="kube-system/global-pull-secret-syncer-vmt4r" Jul 11 01:06:37.342021 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.282962 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a817a6e0-4aaa-40d0-95f4-5daeb4481842-system-cni-dir\") pod \"multus-additional-cni-plugins-tlq4c\" (UID: \"a817a6e0-4aaa-40d0-95f4-5daeb4481842\") " pod="openshift-multus/multus-additional-cni-plugins-tlq4c" Jul 11 01:06:37.343024 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.282991 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bc650005-4617-49c3-a87c-ccd4c5d14b6f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hww5x\" (UID: \"bc650005-4617-49c3-a87c-ccd4c5d14b6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hww5x" Jul 11 01:06:37.343024 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.283000 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ec166c39-ac6d-4182-a8d6-fb0a34eb1915-host\") pod \"node-ca-46bl6\" (UID: \"ec166c39-ac6d-4182-a8d6-fb0a34eb1915\") " pod="openshift-image-registry/node-ca-46bl6" Jul 11 01:06:37.343024 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.283023 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/78a7b886-157e-4df7-9599-c86dfb672085-host\") pod \"tuned-b5t7g\" (UID: \"78a7b886-157e-4df7-9599-c86dfb672085\") " pod="openshift-cluster-node-tuning-operator/tuned-b5t7g" Jul 11 01:06:37.343024 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.283053 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfkqm\" (UniqueName: \"kubernetes.io/projected/78a7b886-157e-4df7-9599-c86dfb672085-kube-api-access-nfkqm\") pod \"tuned-b5t7g\" (UID: \"78a7b886-157e-4df7-9599-c86dfb672085\") " pod="openshift-cluster-node-tuning-operator/tuned-b5t7g" Jul 11 01:06:37.343024 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.283094 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bc650005-4617-49c3-a87c-ccd4c5d14b6f-run-ovn\") pod \"ovnkube-node-hww5x\" (UID: \"bc650005-4617-49c3-a87c-ccd4c5d14b6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hww5x" Jul 11 01:06:37.343024 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.283127 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/78a7b886-157e-4df7-9599-c86dfb672085-etc-sysctl-d\") pod \"tuned-b5t7g\" (UID: \"78a7b886-157e-4df7-9599-c86dfb672085\") " pod="openshift-cluster-node-tuning-operator/tuned-b5t7g" Jul 11 01:06:37.343024 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.283157 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/78a7b886-157e-4df7-9599-c86dfb672085-lib-modules\") pod \"tuned-b5t7g\" (UID: \"78a7b886-157e-4df7-9599-c86dfb672085\") " pod="openshift-cluster-node-tuning-operator/tuned-b5t7g" Jul 11 01:06:37.343024 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.283181 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/db99d519-c8a2-40f5-b238-123774baa78a-multus-cni-dir\") pod \"multus-ff2g5\" (UID: \"db99d519-c8a2-40f5-b238-123774baa78a\") " pod="openshift-multus/multus-ff2g5" Jul 11 01:06:37.343024 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.283209 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a817a6e0-4aaa-40d0-95f4-5daeb4481842-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tlq4c\" (UID: \"a817a6e0-4aaa-40d0-95f4-5daeb4481842\") " pod="openshift-multus/multus-additional-cni-plugins-tlq4c" Jul 11 01:06:37.343024 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.283238 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5d4af8ec-f681-4671-939b-db461fb0dc06-host-slash\") pod \"iptables-alerter-t2ztp\" (UID: \"5d4af8ec-f681-4671-939b-db461fb0dc06\") " pod="openshift-network-operator/iptables-alerter-t2ztp" Jul 11 01:06:37.343024 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.283262 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bc650005-4617-49c3-a87c-ccd4c5d14b6f-env-overrides\") pod \"ovnkube-node-hww5x\" (UID: \"bc650005-4617-49c3-a87c-ccd4c5d14b6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hww5x" Jul 11 01:06:37.343024 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.283266 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/db99d519-c8a2-40f5-b238-123774baa78a-cni-binary-copy\") pod \"multus-ff2g5\" (UID: \"db99d519-c8a2-40f5-b238-123774baa78a\") " pod="openshift-multus/multus-ff2g5" Jul 11 01:06:37.343024 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.283354 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/78a7b886-157e-4df7-9599-c86dfb672085-etc-sysconfig\") pod \"tuned-b5t7g\" (UID: \"78a7b886-157e-4df7-9599-c86dfb672085\") " pod="openshift-cluster-node-tuning-operator/tuned-b5t7g" Jul 11 01:06:37.343024 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.285652 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e1e3c11c-1b4f-4101-8df4-2e9f1d13a67c-tmp-dir\") pod \"node-resolver-jjd8d\" (UID: \"e1e3c11c-1b4f-4101-8df4-2e9f1d13a67c\") " pod="openshift-dns/node-resolver-jjd8d" Jul 11 01:06:37.343024 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.285860 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mmk5\" (UniqueName: \"kubernetes.io/projected/db99d519-c8a2-40f5-b238-123774baa78a-kube-api-access-4mmk5\") pod \"multus-ff2g5\" (UID: \"db99d519-c8a2-40f5-b238-123774baa78a\") " pod="openshift-multus/multus-ff2g5" Jul 11 01:06:37.343024 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.285900 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4f51f053-17f3-44cc-8b0e-0ca541b7370e-registration-dir\") pod \"aws-ebs-csi-driver-node-457jl\" (UID: \"4f51f053-17f3-44cc-8b0e-0ca541b7370e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-457jl" Jul 11 01:06:37.343024 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.285925 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/78a7b886-157e-4df7-9599-c86dfb672085-etc-systemd\") pod \"tuned-b5t7g\" (UID: \"78a7b886-157e-4df7-9599-c86dfb672085\") " pod="openshift-cluster-node-tuning-operator/tuned-b5t7g" Jul 11 01:06:37.345164 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.285954 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ec166c39-ac6d-4182-a8d6-fb0a34eb1915-serviceca\") pod \"node-ca-46bl6\" (UID: \"ec166c39-ac6d-4182-a8d6-fb0a34eb1915\") " pod="openshift-image-registry/node-ca-46bl6" Jul 11 01:06:37.345164 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.286009 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/db99d519-c8a2-40f5-b238-123774baa78a-cnibin\") pod \"multus-ff2g5\" (UID: \"db99d519-c8a2-40f5-b238-123774baa78a\") " pod="openshift-multus/multus-ff2g5" Jul 11 01:06:37.345164 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.286050 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/db99d519-c8a2-40f5-b238-123774baa78a-host-var-lib-cni-multus\") pod \"multus-ff2g5\" (UID: \"db99d519-c8a2-40f5-b238-123774baa78a\") " pod="openshift-multus/multus-ff2g5" Jul 11 01:06:37.345164 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.286093 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/78a7b886-157e-4df7-9599-c86dfb672085-etc-kubernetes\") pod \"tuned-b5t7g\" (UID: \"78a7b886-157e-4df7-9599-c86dfb672085\") " pod="openshift-cluster-node-tuning-operator/tuned-b5t7g" Jul 11 01:06:37.345164 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.286125 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/78a7b886-157e-4df7-9599-c86dfb672085-var-lib-kubelet\") pod \"tuned-b5t7g\" (UID: \"78a7b886-157e-4df7-9599-c86dfb672085\") " pod="openshift-cluster-node-tuning-operator/tuned-b5t7g" Jul 11 01:06:37.345164 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.286152 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpmml\" (UniqueName: \"kubernetes.io/projected/a817a6e0-4aaa-40d0-95f4-5daeb4481842-kube-api-access-lpmml\") pod \"multus-additional-cni-plugins-tlq4c\" (UID: \"a817a6e0-4aaa-40d0-95f4-5daeb4481842\") " pod="openshift-multus/multus-additional-cni-plugins-tlq4c" Jul 11 01:06:37.345164 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.286181 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bc650005-4617-49c3-a87c-ccd4c5d14b6f-systemd-units\") pod \"ovnkube-node-hww5x\" (UID: \"bc650005-4617-49c3-a87c-ccd4c5d14b6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hww5x" Jul 11 01:06:37.345164 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.286210 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bc650005-4617-49c3-a87c-ccd4c5d14b6f-host-slash\") pod \"ovnkube-node-hww5x\" (UID: \"bc650005-4617-49c3-a87c-ccd4c5d14b6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hww5x" Jul 11 01:06:37.345164 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.286240 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bc650005-4617-49c3-a87c-ccd4c5d14b6f-ovnkube-script-lib\") pod \"ovnkube-node-hww5x\" (UID: \"bc650005-4617-49c3-a87c-ccd4c5d14b6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hww5x" Jul 11 01:06:37.345164 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.286268 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4f51f053-17f3-44cc-8b0e-0ca541b7370e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-457jl\" (UID: \"4f51f053-17f3-44cc-8b0e-0ca541b7370e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-457jl" Jul 11 01:06:37.345164 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.286297 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4f51f053-17f3-44cc-8b0e-0ca541b7370e-sys-fs\") pod \"aws-ebs-csi-driver-node-457jl\" (UID: \"4f51f053-17f3-44cc-8b0e-0ca541b7370e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-457jl" Jul 11 01:06:37.345164 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.286327 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ec166c39-ac6d-4182-a8d6-fb0a34eb1915-serviceca\") pod \"node-ca-46bl6\" (UID: \"ec166c39-ac6d-4182-a8d6-fb0a34eb1915\") " pod="openshift-image-registry/node-ca-46bl6" Jul 11 01:06:37.345164 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.286379 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/db99d519-c8a2-40f5-b238-123774baa78a-host-var-lib-kubelet\") pod \"multus-ff2g5\" (UID: \"db99d519-c8a2-40f5-b238-123774baa78a\") " pod="openshift-multus/multus-ff2g5" Jul 11 01:06:37.345164 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.286426 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a817a6e0-4aaa-40d0-95f4-5daeb4481842-system-cni-dir\") pod \"multus-additional-cni-plugins-tlq4c\" (UID: \"a817a6e0-4aaa-40d0-95f4-5daeb4481842\") " pod="openshift-multus/multus-additional-cni-plugins-tlq4c" Jul 11 01:06:37.345164 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.286475 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bc650005-4617-49c3-a87c-ccd4c5d14b6f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hww5x\" (UID: \"bc650005-4617-49c3-a87c-ccd4c5d14b6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hww5x" Jul 11 01:06:37.345164 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.286535 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/78a7b886-157e-4df7-9599-c86dfb672085-host\") pod \"tuned-b5t7g\" (UID: \"78a7b886-157e-4df7-9599-c86dfb672085\") " pod="openshift-cluster-node-tuning-operator/tuned-b5t7g" Jul 11 01:06:37.345164 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.286580 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/db99d519-c8a2-40f5-b238-123774baa78a-host-var-lib-cni-multus\") pod \"multus-ff2g5\" (UID: \"db99d519-c8a2-40f5-b238-123774baa78a\") " pod="openshift-multus/multus-ff2g5" Jul 11 01:06:37.346031 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.286626 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/78a7b886-157e-4df7-9599-c86dfb672085-etc-kubernetes\") pod \"tuned-b5t7g\" (UID: \"78a7b886-157e-4df7-9599-c86dfb672085\") " pod="openshift-cluster-node-tuning-operator/tuned-b5t7g" Jul 11 01:06:37.346031 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.286674 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/78a7b886-157e-4df7-9599-c86dfb672085-var-lib-kubelet\") pod \"tuned-b5t7g\" (UID: \"78a7b886-157e-4df7-9599-c86dfb672085\") " pod="openshift-cluster-node-tuning-operator/tuned-b5t7g" Jul 11 01:06:37.346031 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.286943 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/78a7b886-157e-4df7-9599-c86dfb672085-sys\") pod \"tuned-b5t7g\" (UID: \"78a7b886-157e-4df7-9599-c86dfb672085\") " pod="openshift-cluster-node-tuning-operator/tuned-b5t7g" Jul 11 01:06:37.346031 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.287550 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bc650005-4617-49c3-a87c-ccd4c5d14b6f-ovnkube-script-lib\") pod \"ovnkube-node-hww5x\" (UID: \"bc650005-4617-49c3-a87c-ccd4c5d14b6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hww5x" Jul 11 01:06:37.346031 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.287598 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bc650005-4617-49c3-a87c-ccd4c5d14b6f-systemd-units\") pod \"ovnkube-node-hww5x\" (UID: \"bc650005-4617-49c3-a87c-ccd4c5d14b6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hww5x" Jul 11 01:06:37.346031 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.287628 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bc650005-4617-49c3-a87c-ccd4c5d14b6f-host-slash\") pod \"ovnkube-node-hww5x\" (UID: \"bc650005-4617-49c3-a87c-ccd4c5d14b6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hww5x" Jul 11 01:06:37.346031 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.287674 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4f51f053-17f3-44cc-8b0e-0ca541b7370e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-457jl\" (UID: \"4f51f053-17f3-44cc-8b0e-0ca541b7370e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-457jl" Jul 11 01:06:37.346031 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.287730 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4f51f053-17f3-44cc-8b0e-0ca541b7370e-sys-fs\") pod \"aws-ebs-csi-driver-node-457jl\" (UID: \"4f51f053-17f3-44cc-8b0e-0ca541b7370e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-457jl" Jul 11 01:06:37.346031 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.288047 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a817a6e0-4aaa-40d0-95f4-5daeb4481842-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tlq4c\" (UID: \"a817a6e0-4aaa-40d0-95f4-5daeb4481842\") " pod="openshift-multus/multus-additional-cni-plugins-tlq4c" Jul 11 01:06:37.346031 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.288098 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bc650005-4617-49c3-a87c-ccd4c5d14b6f-run-ovn\") pod \"ovnkube-node-hww5x\" (UID: \"bc650005-4617-49c3-a87c-ccd4c5d14b6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hww5x" Jul 11 01:06:37.346031 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.288171 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/78a7b886-157e-4df7-9599-c86dfb672085-etc-sysctl-d\") pod \"tuned-b5t7g\" (UID: \"78a7b886-157e-4df7-9599-c86dfb672085\") " pod="openshift-cluster-node-tuning-operator/tuned-b5t7g" Jul 11 01:06:37.346031 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.288248 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/78a7b886-157e-4df7-9599-c86dfb672085-lib-modules\") pod \"tuned-b5t7g\" (UID: \"78a7b886-157e-4df7-9599-c86dfb672085\") " pod="openshift-cluster-node-tuning-operator/tuned-b5t7g" Jul 11 01:06:37.346031 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.288299 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/db99d519-c8a2-40f5-b238-123774baa78a-multus-cni-dir\") pod \"multus-ff2g5\" (UID: \"db99d519-c8a2-40f5-b238-123774baa78a\") " pod="openshift-multus/multus-ff2g5" Jul 11 01:06:37.346031 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.288587 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4f51f053-17f3-44cc-8b0e-0ca541b7370e-registration-dir\") pod \"aws-ebs-csi-driver-node-457jl\" (UID: \"4f51f053-17f3-44cc-8b0e-0ca541b7370e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-457jl" Jul 11 01:06:37.346031 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.288626 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5d4af8ec-f681-4671-939b-db461fb0dc06-host-slash\") pod \"iptables-alerter-t2ztp\" (UID: \"5d4af8ec-f681-4671-939b-db461fb0dc06\") " pod="openshift-network-operator/iptables-alerter-t2ztp" Jul 11 01:06:37.346031 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.286329 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/78a7b886-157e-4df7-9599-c86dfb672085-tmp\") pod \"tuned-b5t7g\" (UID: \"78a7b886-157e-4df7-9599-c86dfb672085\") " pod="openshift-cluster-node-tuning-operator/tuned-b5t7g" Jul 11 01:06:37.346031 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.291543 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/db99d519-c8a2-40f5-b238-123774baa78a-cni-binary-copy\") pod \"multus-ff2g5\" (UID: \"db99d519-c8a2-40f5-b238-123774baa78a\") " pod="openshift-multus/multus-ff2g5" Jul 11 01:06:37.346031 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.291743 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/db99d519-c8a2-40f5-b238-123774baa78a-hostroot\") pod \"multus-ff2g5\" (UID: \"db99d519-c8a2-40f5-b238-123774baa78a\") " pod="openshift-multus/multus-ff2g5" Jul 11 01:06:37.349232 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.291748 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bc650005-4617-49c3-a87c-ccd4c5d14b6f-ovn-node-metrics-cert\") pod \"ovnkube-node-hww5x\" (UID: \"bc650005-4617-49c3-a87c-ccd4c5d14b6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hww5x" Jul 11 01:06:37.349232 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.291806 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/db99d519-c8a2-40f5-b238-123774baa78a-host-run-multus-certs\") pod \"multus-ff2g5\" (UID: \"db99d519-c8a2-40f5-b238-123774baa78a\") " pod="openshift-multus/multus-ff2g5" Jul 11 01:06:37.349232 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.291842 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfl99\" (UniqueName: \"kubernetes.io/projected/95087320-8e0c-484c-b734-3360faeff948-kube-api-access-nfl99\") pod \"network-check-target-m82rx\" (UID: \"95087320-8e0c-484c-b734-3360faeff948\") " pod="openshift-network-diagnostics/network-check-target-m82rx" Jul 11 01:06:37.349232 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.291845 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5d4af8ec-f681-4671-939b-db461fb0dc06-iptables-alerter-script\") pod \"iptables-alerter-t2ztp\" (UID: \"5d4af8ec-f681-4671-939b-db461fb0dc06\") " pod="openshift-network-operator/iptables-alerter-t2ztp" Jul 11 01:06:37.349232 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.291852 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/78a7b886-157e-4df7-9599-c86dfb672085-etc-systemd\") pod \"tuned-b5t7g\" (UID: \"78a7b886-157e-4df7-9599-c86dfb672085\") " pod="openshift-cluster-node-tuning-operator/tuned-b5t7g" Jul 11 01:06:37.349232 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.292006 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/78a7b886-157e-4df7-9599-c86dfb672085-etc-tuned\") pod \"tuned-b5t7g\" (UID: \"78a7b886-157e-4df7-9599-c86dfb672085\") " pod="openshift-cluster-node-tuning-operator/tuned-b5t7g" Jul 11 01:06:37.349232 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.292084 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/78a7b886-157e-4df7-9599-c86dfb672085-etc-sysctl-conf\") pod \"tuned-b5t7g\" (UID: \"78a7b886-157e-4df7-9599-c86dfb672085\") " pod="openshift-cluster-node-tuning-operator/tuned-b5t7g" Jul 11 01:06:37.349232 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.292055 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/db99d519-c8a2-40f5-b238-123774baa78a-hostroot\") pod \"multus-ff2g5\" (UID: \"db99d519-c8a2-40f5-b238-123774baa78a\") " pod="openshift-multus/multus-ff2g5" Jul 11 01:06:37.349232 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.292153 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/db99d519-c8a2-40f5-b238-123774baa78a-host-run-multus-certs\") pod \"multus-ff2g5\" (UID: \"db99d519-c8a2-40f5-b238-123774baa78a\") " pod="openshift-multus/multus-ff2g5" Jul 11 01:06:37.349232 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.292132 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/db99d519-c8a2-40f5-b238-123774baa78a-system-cni-dir\") pod \"multus-ff2g5\" (UID: \"db99d519-c8a2-40f5-b238-123774baa78a\") " pod="openshift-multus/multus-ff2g5" Jul 11 01:06:37.349232 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.292206 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bc650005-4617-49c3-a87c-ccd4c5d14b6f-ovnkube-config\") pod \"ovnkube-node-hww5x\" (UID: \"bc650005-4617-49c3-a87c-ccd4c5d14b6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hww5x" Jul 11 01:06:37.349232 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.292250 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7494d\" (UniqueName: \"kubernetes.io/projected/bc650005-4617-49c3-a87c-ccd4c5d14b6f-kube-api-access-7494d\") pod \"ovnkube-node-hww5x\" (UID: \"bc650005-4617-49c3-a87c-ccd4c5d14b6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hww5x" Jul 11 01:06:37.349232 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.292295 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/99a7e6d5-7736-4a0e-b4c2-12f925deb1b2-dbus\") pod \"global-pull-secret-syncer-vmt4r\" (UID: \"99a7e6d5-7736-4a0e-b4c2-12f925deb1b2\") " pod="kube-system/global-pull-secret-syncer-vmt4r" Jul 11 01:06:37.349232 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.292319 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4f51f053-17f3-44cc-8b0e-0ca541b7370e-device-dir\") pod \"aws-ebs-csi-driver-node-457jl\" (UID: \"4f51f053-17f3-44cc-8b0e-0ca541b7370e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-457jl" Jul 11 01:06:37.349232 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.292345 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxvnr\" (UniqueName: \"kubernetes.io/projected/5d4af8ec-f681-4671-939b-db461fb0dc06-kube-api-access-pxvnr\") pod \"iptables-alerter-t2ztp\" (UID: \"5d4af8ec-f681-4671-939b-db461fb0dc06\") " pod="openshift-network-operator/iptables-alerter-t2ztp" Jul 11 01:06:37.349232 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.292368 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/db99d519-c8a2-40f5-b238-123774baa78a-host-run-netns\") pod \"multus-ff2g5\" (UID: \"db99d519-c8a2-40f5-b238-123774baa78a\") " pod="openshift-multus/multus-ff2g5" Jul 11 01:06:37.349232 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.292392 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a817a6e0-4aaa-40d0-95f4-5daeb4481842-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tlq4c\" (UID: \"a817a6e0-4aaa-40d0-95f4-5daeb4481842\") " pod="openshift-multus/multus-additional-cni-plugins-tlq4c" Jul 11 01:06:37.350093 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.292446 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bc650005-4617-49c3-a87c-ccd4c5d14b6f-run-openvswitch\") pod \"ovnkube-node-hww5x\" (UID: \"bc650005-4617-49c3-a87c-ccd4c5d14b6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hww5x" Jul 11 01:06:37.350093 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.292538 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/99a7e6d5-7736-4a0e-b4c2-12f925deb1b2-dbus\") pod \"global-pull-secret-syncer-vmt4r\" (UID: \"99a7e6d5-7736-4a0e-b4c2-12f925deb1b2\") " pod="kube-system/global-pull-secret-syncer-vmt4r" Jul 11 01:06:37.350093 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.292539 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/78a7b886-157e-4df7-9599-c86dfb672085-etc-sysctl-conf\") pod \"tuned-b5t7g\" (UID: \"78a7b886-157e-4df7-9599-c86dfb672085\") " pod="openshift-cluster-node-tuning-operator/tuned-b5t7g" Jul 11 01:06:37.350093 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.292583 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/db99d519-c8a2-40f5-b238-123774baa78a-system-cni-dir\") pod \"multus-ff2g5\" (UID: \"db99d519-c8a2-40f5-b238-123774baa78a\") " pod="openshift-multus/multus-ff2g5" Jul 11 01:06:37.350093 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.292587 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bc650005-4617-49c3-a87c-ccd4c5d14b6f-run-openvswitch\") pod \"ovnkube-node-hww5x\" (UID: \"bc650005-4617-49c3-a87c-ccd4c5d14b6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hww5x" Jul 11 01:06:37.350093 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.292632 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4f51f053-17f3-44cc-8b0e-0ca541b7370e-device-dir\") pod \"aws-ebs-csi-driver-node-457jl\" (UID: \"4f51f053-17f3-44cc-8b0e-0ca541b7370e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-457jl" Jul 11 01:06:37.350093 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.293011 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bc650005-4617-49c3-a87c-ccd4c5d14b6f-ovnkube-config\") pod \"ovnkube-node-hww5x\" (UID: \"bc650005-4617-49c3-a87c-ccd4c5d14b6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hww5x" Jul 11 01:06:37.350093 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.293098 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/db99d519-c8a2-40f5-b238-123774baa78a-host-run-netns\") pod \"multus-ff2g5\" (UID: \"db99d519-c8a2-40f5-b238-123774baa78a\") " pod="openshift-multus/multus-ff2g5" Jul 11 01:06:37.350093 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.293221 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a817a6e0-4aaa-40d0-95f4-5daeb4481842-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tlq4c\" (UID: \"a817a6e0-4aaa-40d0-95f4-5daeb4481842\") " pod="openshift-multus/multus-additional-cni-plugins-tlq4c" Jul 11 01:06:37.350093 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.293259 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bc650005-4617-49c3-a87c-ccd4c5d14b6f-log-socket\") pod \"ovnkube-node-hww5x\" (UID: \"bc650005-4617-49c3-a87c-ccd4c5d14b6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hww5x" Jul 11 01:06:37.350093 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.293280 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bc650005-4617-49c3-a87c-ccd4c5d14b6f-host-run-ovn-kubernetes\") pod \"ovnkube-node-hww5x\" (UID: \"bc650005-4617-49c3-a87c-ccd4c5d14b6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hww5x" Jul 11 01:06:37.350093 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.293311 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bc650005-4617-49c3-a87c-ccd4c5d14b6f-host-cni-bin\") pod \"ovnkube-node-hww5x\" (UID: \"bc650005-4617-49c3-a87c-ccd4c5d14b6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hww5x" Jul 11 01:06:37.350093 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.293335 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/99a7e6d5-7736-4a0e-b4c2-12f925deb1b2-original-pull-secret\") pod \"global-pull-secret-syncer-vmt4r\" (UID: \"99a7e6d5-7736-4a0e-b4c2-12f925deb1b2\") " pod="kube-system/global-pull-secret-syncer-vmt4r" Jul 11 01:06:37.350093 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.293360 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/db99d519-c8a2-40f5-b238-123774baa78a-multus-socket-dir-parent\") pod \"multus-ff2g5\" (UID: \"db99d519-c8a2-40f5-b238-123774baa78a\") " pod="openshift-multus/multus-ff2g5" Jul 11 01:06:37.350093 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.293381 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/db99d519-c8a2-40f5-b238-123774baa78a-host-run-k8s-cni-cncf-io\") pod \"multus-ff2g5\" (UID: \"db99d519-c8a2-40f5-b238-123774baa78a\") " pod="openshift-multus/multus-ff2g5" Jul 11 01:06:37.350093 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.293420 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/db99d519-c8a2-40f5-b238-123774baa78a-host-run-k8s-cni-cncf-io\") pod \"multus-ff2g5\" (UID: \"db99d519-c8a2-40f5-b238-123774baa78a\") " pod="openshift-multus/multus-ff2g5" Jul 11 01:06:37.350093 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.293465 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bc650005-4617-49c3-a87c-ccd4c5d14b6f-log-socket\") pod \"ovnkube-node-hww5x\" (UID: \"bc650005-4617-49c3-a87c-ccd4c5d14b6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hww5x" Jul 11 01:06:37.353091 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.293497 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bc650005-4617-49c3-a87c-ccd4c5d14b6f-host-run-ovn-kubernetes\") pod \"ovnkube-node-hww5x\" (UID: \"bc650005-4617-49c3-a87c-ccd4c5d14b6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hww5x" Jul 11 01:06:37.353091 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.293529 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bc650005-4617-49c3-a87c-ccd4c5d14b6f-host-cni-bin\") pod \"ovnkube-node-hww5x\" (UID: \"bc650005-4617-49c3-a87c-ccd4c5d14b6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hww5x" Jul 11 01:06:37.353091 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.293610 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/db99d519-c8a2-40f5-b238-123774baa78a-multus-socket-dir-parent\") pod \"multus-ff2g5\" (UID: \"db99d519-c8a2-40f5-b238-123774baa78a\") " pod="openshift-multus/multus-ff2g5" Jul 11 01:06:37.353091 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.293637 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a817a6e0-4aaa-40d0-95f4-5daeb4481842-os-release\") pod \"multus-additional-cni-plugins-tlq4c\" (UID: \"a817a6e0-4aaa-40d0-95f4-5daeb4481842\") " pod="openshift-multus/multus-additional-cni-plugins-tlq4c" Jul 11 01:06:37.353091 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.293662 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bc650005-4617-49c3-a87c-ccd4c5d14b6f-host-run-netns\") pod \"ovnkube-node-hww5x\" (UID: \"bc650005-4617-49c3-a87c-ccd4c5d14b6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hww5x" Jul 11 01:06:37.353091 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.293684 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bc650005-4617-49c3-a87c-ccd4c5d14b6f-host-cni-netd\") pod \"ovnkube-node-hww5x\" (UID: \"bc650005-4617-49c3-a87c-ccd4c5d14b6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hww5x" Jul 11 01:06:37.353091 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.293745 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bc650005-4617-49c3-a87c-ccd4c5d14b6f-host-cni-netd\") pod \"ovnkube-node-hww5x\" (UID: \"bc650005-4617-49c3-a87c-ccd4c5d14b6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hww5x" Jul 11 01:06:37.353091 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.293796 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a817a6e0-4aaa-40d0-95f4-5daeb4481842-os-release\") pod \"multus-additional-cni-plugins-tlq4c\" (UID: \"a817a6e0-4aaa-40d0-95f4-5daeb4481842\") " pod="openshift-multus/multus-additional-cni-plugins-tlq4c" Jul 11 01:06:37.353091 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.293828 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bc650005-4617-49c3-a87c-ccd4c5d14b6f-host-run-netns\") pod \"ovnkube-node-hww5x\" (UID: \"bc650005-4617-49c3-a87c-ccd4c5d14b6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hww5x" Jul 11 01:06:37.353091 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:37.293938 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 11 01:06:37.353091 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.293977 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6de25e6a-b433-4f08-941a-9666d215fe54-metrics-certs\") pod \"network-metrics-daemon-4j8b6\" (UID: \"6de25e6a-b433-4f08-941a-9666d215fe54\") " pod="openshift-multus/network-metrics-daemon-4j8b6" Jul 11 01:06:37.353091 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.294005 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gx8d\" (UniqueName: \"kubernetes.io/projected/6de25e6a-b433-4f08-941a-9666d215fe54-kube-api-access-6gx8d\") pod \"network-metrics-daemon-4j8b6\" (UID: \"6de25e6a-b433-4f08-941a-9666d215fe54\") " pod="openshift-multus/network-metrics-daemon-4j8b6" Jul 11 01:06:37.353091 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.294216 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/78a7b886-157e-4df7-9599-c86dfb672085-tmp\") pod \"tuned-b5t7g\" (UID: \"78a7b886-157e-4df7-9599-c86dfb672085\") " pod="openshift-cluster-node-tuning-operator/tuned-b5t7g" Jul 11 01:06:37.353091 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:37.294295 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 11 01:06:37.353091 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.294806 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5kgr\" (UniqueName: \"kubernetes.io/projected/4f51f053-17f3-44cc-8b0e-0ca541b7370e-kube-api-access-n5kgr\") pod \"aws-ebs-csi-driver-node-457jl\" (UID: \"4f51f053-17f3-44cc-8b0e-0ca541b7370e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-457jl" Jul 11 01:06:37.353091 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.295231 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfkqm\" (UniqueName: \"kubernetes.io/projected/78a7b886-157e-4df7-9599-c86dfb672085-kube-api-access-nfkqm\") pod \"tuned-b5t7g\" (UID: \"78a7b886-157e-4df7-9599-c86dfb672085\") " pod="openshift-cluster-node-tuning-operator/tuned-b5t7g" Jul 11 01:06:37.353091 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.295520 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sb2t9\" (UniqueName: \"kubernetes.io/projected/e1e3c11c-1b4f-4101-8df4-2e9f1d13a67c-kube-api-access-sb2t9\") pod \"node-resolver-jjd8d\" (UID: \"e1e3c11c-1b4f-4101-8df4-2e9f1d13a67c\") " pod="openshift-dns/node-resolver-jjd8d" Jul 11 01:06:37.353091 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.295675 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsjfw\" (UniqueName: \"kubernetes.io/projected/ec166c39-ac6d-4182-a8d6-fb0a34eb1915-kube-api-access-jsjfw\") pod \"node-ca-46bl6\" (UID: \"ec166c39-ac6d-4182-a8d6-fb0a34eb1915\") " pod="openshift-image-registry/node-ca-46bl6" Jul 11 01:06:37.353091 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:37.297395 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 11 01:06:37.354157 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:37.297413 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 11 01:06:37.354157 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:37.297425 2572 projected.go:196] Error preparing data for projected volume kube-api-access-nfl99 for pod openshift-network-diagnostics/network-check-target-m82rx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 11 01:06:37.354157 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:37.297502 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95087320-8e0c-484c-b734-3360faeff948-kube-api-access-nfl99 podName:95087320-8e0c-484c-b734-3360faeff948 nodeName:}" failed. No retries permitted until 2026-07-11 01:06:37.79748139 +0000 UTC m=+2.128956930 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-nfl99" (UniqueName: "kubernetes.io/projected/95087320-8e0c-484c-b734-3360faeff948-kube-api-access-nfl99") pod "network-check-target-m82rx" (UID: "95087320-8e0c-484c-b734-3360faeff948") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 11 01:06:37.354157 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:37.297532 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6de25e6a-b433-4f08-941a-9666d215fe54-metrics-certs podName:6de25e6a-b433-4f08-941a-9666d215fe54 nodeName:}" failed. No retries permitted until 2026-07-11 01:06:37.797521731 +0000 UTC m=+2.128997269 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6de25e6a-b433-4f08-941a-9666d215fe54-metrics-certs") pod "network-metrics-daemon-4j8b6" (UID: "6de25e6a-b433-4f08-941a-9666d215fe54") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 11 01:06:37.354157 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:37.297548 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99a7e6d5-7736-4a0e-b4c2-12f925deb1b2-original-pull-secret podName:99a7e6d5-7736-4a0e-b4c2-12f925deb1b2 nodeName:}" failed. No retries permitted until 2026-07-11 01:06:37.797540021 +0000 UTC m=+2.129015546 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/99a7e6d5-7736-4a0e-b4c2-12f925deb1b2-original-pull-secret") pod "global-pull-secret-syncer-vmt4r" (UID: "99a7e6d5-7736-4a0e-b4c2-12f925deb1b2") : object "kube-system"/"original-pull-secret" not registered Jul 11 01:06:37.354157 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.298627 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mmk5\" (UniqueName: \"kubernetes.io/projected/db99d519-c8a2-40f5-b238-123774baa78a-kube-api-access-4mmk5\") pod \"multus-ff2g5\" (UID: \"db99d519-c8a2-40f5-b238-123774baa78a\") " pod="openshift-multus/multus-ff2g5" Jul 11 01:06:37.354157 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.299771 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7494d\" (UniqueName: \"kubernetes.io/projected/bc650005-4617-49c3-a87c-ccd4c5d14b6f-kube-api-access-7494d\") pod \"ovnkube-node-hww5x\" (UID: \"bc650005-4617-49c3-a87c-ccd4c5d14b6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-hww5x" Jul 11 01:06:37.354157 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.299829 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpmml\" (UniqueName: \"kubernetes.io/projected/a817a6e0-4aaa-40d0-95f4-5daeb4481842-kube-api-access-lpmml\") pod \"multus-additional-cni-plugins-tlq4c\" (UID: \"a817a6e0-4aaa-40d0-95f4-5daeb4481842\") " pod="openshift-multus/multus-additional-cni-plugins-tlq4c" Jul 11 01:06:37.354157 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.299903 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 11 01:06:37.354157 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.300961 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxvnr\" (UniqueName: \"kubernetes.io/projected/5d4af8ec-f681-4671-939b-db461fb0dc06-kube-api-access-pxvnr\") pod \"iptables-alerter-t2ztp\" (UID: \"5d4af8ec-f681-4671-939b-db461fb0dc06\") " pod="openshift-network-operator/iptables-alerter-t2ztp" Jul 11 01:06:37.354157 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.301181 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gx8d\" (UniqueName: \"kubernetes.io/projected/6de25e6a-b433-4f08-941a-9666d215fe54-kube-api-access-6gx8d\") pod \"network-metrics-daemon-4j8b6\" (UID: \"6de25e6a-b433-4f08-941a-9666d215fe54\") " pod="openshift-multus/network-metrics-daemon-4j8b6" Jul 11 01:06:37.354157 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.350515 2572 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 11 01:06:37.482851 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.395508 2572 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 11 01:06:37.482851 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.404149 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-f6sd8" Jul 11 01:06:37.482851 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:37.415148 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80e2a675_663f_4959_89d2_c97483b65e4c.slice/crio-a30858486a9158d5c92b1615adec9e061cc148cf9f66fdfc96648546a1a84fb1 WatchSource:0}: Error finding container a30858486a9158d5c92b1615adec9e061cc148cf9f66fdfc96648546a1a84fb1: Status 404 returned error can't find the container with id a30858486a9158d5c92b1615adec9e061cc148cf9f66fdfc96648546a1a84fb1 Jul 11 01:06:37.482851 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.419441 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tlq4c" Jul 11 01:06:37.482851 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:37.433185 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda817a6e0_4aaa_40d0_95f4_5daeb4481842.slice/crio-aa3facf0c4550fdb5e0273434bb1c45246e83afd2aa7e3a8f93192abd0fb9058 WatchSource:0}: Error finding container aa3facf0c4550fdb5e0273434bb1c45246e83afd2aa7e3a8f93192abd0fb9058: Status 404 returned error can't find the container with id aa3facf0c4550fdb5e0273434bb1c45246e83afd2aa7e3a8f93192abd0fb9058 Jul 11 01:06:37.482851 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.449039 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-t2ztp" Jul 11 01:06:37.482851 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:37.457432 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d4af8ec_f681_4671_939b_db461fb0dc06.slice/crio-b72be78fff763b60002f1e044559284e7d43035c6750a830f89bc8b7c5623fd5 WatchSource:0}: Error finding container b72be78fff763b60002f1e044559284e7d43035c6750a830f89bc8b7c5623fd5: Status 404 returned error can't find the container with id b72be78fff763b60002f1e044559284e7d43035c6750a830f89bc8b7c5623fd5 Jul 11 01:06:37.482851 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.465224 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hww5x" Jul 11 01:06:37.482851 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:37.472718 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc650005_4617_49c3_a87c_ccd4c5d14b6f.slice/crio-b3b96e57d53e06520ecbc02b477481003ae61d9552ff036f4e4869f885a7cb15 WatchSource:0}: Error finding container b3b96e57d53e06520ecbc02b477481003ae61d9552ff036f4e4869f885a7cb15: Status 404 returned error can't find the container with id b3b96e57d53e06520ecbc02b477481003ae61d9552ff036f4e4869f885a7cb15 Jul 11 01:06:37.657085 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.494409 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-457jl" Jul 11 01:06:37.657085 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.501433 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-b5t7g" Jul 11 01:06:37.657085 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:37.502398 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f51f053_17f3_44cc_8b0e_0ca541b7370e.slice/crio-5685782300da0bbc2fc6e0c463a8bf49810a6692b6fae635830553a1991e86a6 WatchSource:0}: Error finding container 5685782300da0bbc2fc6e0c463a8bf49810a6692b6fae635830553a1991e86a6: Status 404 returned error can't find the container with id 5685782300da0bbc2fc6e0c463a8bf49810a6692b6fae635830553a1991e86a6 Jul 11 01:06:37.657085 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:37.508835 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78a7b886_157e_4df7_9599_c86dfb672085.slice/crio-714cf33880cfdf9f05275dc80a4a6db241062b909a92bf47ae01878b1ec663e2 WatchSource:0}: Error finding container 714cf33880cfdf9f05275dc80a4a6db241062b909a92bf47ae01878b1ec663e2: Status 404 returned error can't find the container with id 714cf33880cfdf9f05275dc80a4a6db241062b909a92bf47ae01878b1ec663e2 Jul 11 01:06:37.657085 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.541501 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jjd8d" Jul 11 01:06:37.657085 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:37.549528 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1e3c11c_1b4f_4101_8df4_2e9f1d13a67c.slice/crio-37cdd319efd42c0a6099587d466f7016e915efa7eda1d3e671216c6d81f46318 WatchSource:0}: Error finding container 37cdd319efd42c0a6099587d466f7016e915efa7eda1d3e671216c6d81f46318: Status 404 returned error can't find the container with id 37cdd319efd42c0a6099587d466f7016e915efa7eda1d3e671216c6d81f46318 Jul 11 01:06:37.657085 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.559584 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-46bl6" Jul 11 01:06:37.657085 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.564177 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ff2g5" Jul 11 01:06:37.657085 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:06:37.568359 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec166c39_ac6d_4182_a8d6_fb0a34eb1915.slice/crio-65143fa49ae5d067f8c078168a9b114db9f6a7fd97daeb6a2c05ce389c273266 WatchSource:0}: Error finding container 65143fa49ae5d067f8c078168a9b114db9f6a7fd97daeb6a2c05ce389c273266: Status 404 returned error can't find the container with id 65143fa49ae5d067f8c078168a9b114db9f6a7fd97daeb6a2c05ce389c273266 Jul 11 01:06:37.799100 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.798352 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfl99\" (UniqueName: \"kubernetes.io/projected/95087320-8e0c-484c-b734-3360faeff948-kube-api-access-nfl99\") pod \"network-check-target-m82rx\" (UID: \"95087320-8e0c-484c-b734-3360faeff948\") " pod="openshift-network-diagnostics/network-check-target-m82rx" Jul 11 01:06:37.799100 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.798402 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/99a7e6d5-7736-4a0e-b4c2-12f925deb1b2-original-pull-secret\") pod \"global-pull-secret-syncer-vmt4r\" (UID: \"99a7e6d5-7736-4a0e-b4c2-12f925deb1b2\") " pod="kube-system/global-pull-secret-syncer-vmt4r" Jul 11 01:06:37.799100 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.798441 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6de25e6a-b433-4f08-941a-9666d215fe54-metrics-certs\") pod \"network-metrics-daemon-4j8b6\" (UID: \"6de25e6a-b433-4f08-941a-9666d215fe54\") " pod="openshift-multus/network-metrics-daemon-4j8b6" Jul 11 01:06:37.799100 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:37.798535 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 11 01:06:37.799100 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:37.798557 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 11 01:06:37.799100 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:37.798567 2572 projected.go:196] Error preparing data for projected volume kube-api-access-nfl99 for pod openshift-network-diagnostics/network-check-target-m82rx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 11 01:06:37.799100 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:37.798605 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 11 01:06:37.799100 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:37.798622 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95087320-8e0c-484c-b734-3360faeff948-kube-api-access-nfl99 podName:95087320-8e0c-484c-b734-3360faeff948 nodeName:}" failed. No retries permitted until 2026-07-11 01:06:38.798602879 +0000 UTC m=+3.130078410 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-nfl99" (UniqueName: "kubernetes.io/projected/95087320-8e0c-484c-b734-3360faeff948-kube-api-access-nfl99") pod "network-check-target-m82rx" (UID: "95087320-8e0c-484c-b734-3360faeff948") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 11 01:06:37.799100 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:37.798669 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99a7e6d5-7736-4a0e-b4c2-12f925deb1b2-original-pull-secret podName:99a7e6d5-7736-4a0e-b4c2-12f925deb1b2 nodeName:}" failed. No retries permitted until 2026-07-11 01:06:38.798650815 +0000 UTC m=+3.130126341 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/99a7e6d5-7736-4a0e-b4c2-12f925deb1b2-original-pull-secret") pod "global-pull-secret-syncer-vmt4r" (UID: "99a7e6d5-7736-4a0e-b4c2-12f925deb1b2") : object "kube-system"/"original-pull-secret" not registered Jul 11 01:06:37.799100 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:37.798684 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 11 01:06:37.799100 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:37.798749 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6de25e6a-b433-4f08-941a-9666d215fe54-metrics-certs podName:6de25e6a-b433-4f08-941a-9666d215fe54 nodeName:}" failed. No retries permitted until 2026-07-11 01:06:38.79872763 +0000 UTC m=+3.130203169 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6de25e6a-b433-4f08-941a-9666d215fe54-metrics-certs") pod "network-metrics-daemon-4j8b6" (UID: "6de25e6a-b433-4f08-941a-9666d215fe54") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 11 01:06:37.917504 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:37.917432 2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 11 01:06:38.113914 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:38.113840 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-10 01:01:37 +0000 UTC" deadline="2028-02-05 13:18:31.217701978 +0000 UTC" Jul 11 01:06:38.113914 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:38.113912 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13788h11m53.103793915s" Jul 11 01:06:38.251713 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:38.251452 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m82rx" Jul 11 01:06:38.251713 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:38.251577 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m82rx" podUID="95087320-8e0c-484c-b734-3360faeff948" Jul 11 01:06:38.277646 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:38.277588 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-46bl6" event={"ID":"ec166c39-ac6d-4182-a8d6-fb0a34eb1915","Type":"ContainerStarted","Data":"65143fa49ae5d067f8c078168a9b114db9f6a7fd97daeb6a2c05ce389c273266"} Jul 11 01:06:38.299032 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:38.298929 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-b5t7g" event={"ID":"78a7b886-157e-4df7-9599-c86dfb672085","Type":"ContainerStarted","Data":"714cf33880cfdf9f05275dc80a4a6db241062b909a92bf47ae01878b1ec663e2"} Jul 11 01:06:38.315914 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:38.315870 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-457jl" event={"ID":"4f51f053-17f3-44cc-8b0e-0ca541b7370e","Type":"ContainerStarted","Data":"5685782300da0bbc2fc6e0c463a8bf49810a6692b6fae635830553a1991e86a6"} Jul 11 01:06:38.337177 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:38.337139 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tlq4c" event={"ID":"a817a6e0-4aaa-40d0-95f4-5daeb4481842","Type":"ContainerStarted","Data":"aa3facf0c4550fdb5e0273434bb1c45246e83afd2aa7e3a8f93192abd0fb9058"} Jul 11 01:06:38.366629 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:38.366487 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-f6sd8" event={"ID":"80e2a675-663f-4959-89d2-c97483b65e4c","Type":"ContainerStarted","Data":"a30858486a9158d5c92b1615adec9e061cc148cf9f66fdfc96648546a1a84fb1"} Jul 11 01:06:38.415243 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:38.414630 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-161.ec2.internal" event={"ID":"7d6d27db974b8b86e3da7428c71f54c4","Type":"ContainerStarted","Data":"fa0d7e8ae7f1dab334718c6ee49d706c3d749a304380847c2b52d2defb4a05a7"} Jul 11 01:06:38.424923 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:38.424888 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ff2g5" event={"ID":"db99d519-c8a2-40f5-b238-123774baa78a","Type":"ContainerStarted","Data":"5a287ae23d93ebf561c64f8f9d9c478c2c0e1d1423295dbe5eb4e30b0d381d11"} Jul 11 01:06:38.445795 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:38.445719 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jjd8d" event={"ID":"e1e3c11c-1b4f-4101-8df4-2e9f1d13a67c","Type":"ContainerStarted","Data":"37cdd319efd42c0a6099587d466f7016e915efa7eda1d3e671216c6d81f46318"} Jul 11 01:06:38.471517 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:38.471478 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hww5x" event={"ID":"bc650005-4617-49c3-a87c-ccd4c5d14b6f","Type":"ContainerStarted","Data":"b3b96e57d53e06520ecbc02b477481003ae61d9552ff036f4e4869f885a7cb15"} Jul 11 01:06:38.512342 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:38.512257 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-t2ztp" event={"ID":"5d4af8ec-f681-4671-939b-db461fb0dc06","Type":"ContainerStarted","Data":"b72be78fff763b60002f1e044559284e7d43035c6750a830f89bc8b7c5623fd5"} Jul 11 01:06:38.525246 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:38.525189 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-161.ec2.internal" event={"ID":"ddc18782af4676c4d2733345c70ab795","Type":"ContainerStarted","Data":"cfbbe3b13ce63d18c96c6fe9cbbcb6a41eb8000d00c22f1266ee02c77a857305"} Jul 11 01:06:38.757084 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:38.757051 2572 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 11 01:06:38.809176 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:38.808553 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfl99\" (UniqueName: \"kubernetes.io/projected/95087320-8e0c-484c-b734-3360faeff948-kube-api-access-nfl99\") pod \"network-check-target-m82rx\" (UID: \"95087320-8e0c-484c-b734-3360faeff948\") " pod="openshift-network-diagnostics/network-check-target-m82rx" Jul 11 01:06:38.809176 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:38.808609 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/99a7e6d5-7736-4a0e-b4c2-12f925deb1b2-original-pull-secret\") pod \"global-pull-secret-syncer-vmt4r\" (UID: \"99a7e6d5-7736-4a0e-b4c2-12f925deb1b2\") " pod="kube-system/global-pull-secret-syncer-vmt4r" Jul 11 01:06:38.809176 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:38.808638 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6de25e6a-b433-4f08-941a-9666d215fe54-metrics-certs\") pod \"network-metrics-daemon-4j8b6\" (UID: \"6de25e6a-b433-4f08-941a-9666d215fe54\") " pod="openshift-multus/network-metrics-daemon-4j8b6" Jul 11 01:06:38.809176 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:38.808764 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 11 01:06:38.809176 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:38.808810 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 11 01:06:38.809176 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:38.808820 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6de25e6a-b433-4f08-941a-9666d215fe54-metrics-certs podName:6de25e6a-b433-4f08-941a-9666d215fe54 nodeName:}" failed. No retries permitted until 2026-07-11 01:06:40.808803147 +0000 UTC m=+5.140278683 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6de25e6a-b433-4f08-941a-9666d215fe54-metrics-certs") pod "network-metrics-daemon-4j8b6" (UID: "6de25e6a-b433-4f08-941a-9666d215fe54") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 11 01:06:38.809176 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:38.808829 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 11 01:06:38.809176 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:38.808841 2572 projected.go:196] Error preparing data for projected volume kube-api-access-nfl99 for pod openshift-network-diagnostics/network-check-target-m82rx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 11 01:06:38.809176 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:38.808874 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95087320-8e0c-484c-b734-3360faeff948-kube-api-access-nfl99 podName:95087320-8e0c-484c-b734-3360faeff948 nodeName:}" failed. No retries permitted until 2026-07-11 01:06:40.808863726 +0000 UTC m=+5.140339263 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-nfl99" (UniqueName: "kubernetes.io/projected/95087320-8e0c-484c-b734-3360faeff948-kube-api-access-nfl99") pod "network-check-target-m82rx" (UID: "95087320-8e0c-484c-b734-3360faeff948") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 11 01:06:38.809176 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:38.808934 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 11 01:06:38.809176 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:38.808963 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99a7e6d5-7736-4a0e-b4c2-12f925deb1b2-original-pull-secret podName:99a7e6d5-7736-4a0e-b4c2-12f925deb1b2 nodeName:}" failed. No retries permitted until 2026-07-11 01:06:40.808952754 +0000 UTC m=+5.140428291 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/99a7e6d5-7736-4a0e-b4c2-12f925deb1b2-original-pull-secret") pod "global-pull-secret-syncer-vmt4r" (UID: "99a7e6d5-7736-4a0e-b4c2-12f925deb1b2") : object "kube-system"/"original-pull-secret" not registered Jul 11 01:06:39.114961 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:39.114876 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-10 01:01:37 +0000 UTC" deadline="2028-04-04 22:41:03.274376262 +0000 UTC" Jul 11 01:06:39.115120 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:39.114917 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15213h34m24.159464001s" Jul 11 01:06:39.251907 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:39.251873 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4j8b6" Jul 11 01:06:39.252348 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:39.252019 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4j8b6" podUID="6de25e6a-b433-4f08-941a-9666d215fe54" Jul 11 01:06:39.252446 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:39.252429 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmt4r" Jul 11 01:06:39.252539 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:39.252522 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vmt4r" podUID="99a7e6d5-7736-4a0e-b4c2-12f925deb1b2" Jul 11 01:06:40.253742 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:40.252996 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m82rx" Jul 11 01:06:40.254271 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:40.253751 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m82rx" podUID="95087320-8e0c-484c-b734-3360faeff948" Jul 11 01:06:40.826344 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:40.826298 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfl99\" (UniqueName: \"kubernetes.io/projected/95087320-8e0c-484c-b734-3360faeff948-kube-api-access-nfl99\") pod \"network-check-target-m82rx\" (UID: \"95087320-8e0c-484c-b734-3360faeff948\") " pod="openshift-network-diagnostics/network-check-target-m82rx" Jul 11 01:06:40.826544 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:40.826362 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/99a7e6d5-7736-4a0e-b4c2-12f925deb1b2-original-pull-secret\") pod \"global-pull-secret-syncer-vmt4r\" (UID: \"99a7e6d5-7736-4a0e-b4c2-12f925deb1b2\") " pod="kube-system/global-pull-secret-syncer-vmt4r" Jul 11 01:06:40.826544 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:40.826398 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6de25e6a-b433-4f08-941a-9666d215fe54-metrics-certs\") pod \"network-metrics-daemon-4j8b6\" (UID: \"6de25e6a-b433-4f08-941a-9666d215fe54\") " pod="openshift-multus/network-metrics-daemon-4j8b6" Jul 11 01:06:40.826668 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:40.826568 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 11 01:06:40.826668 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:40.826645 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6de25e6a-b433-4f08-941a-9666d215fe54-metrics-certs podName:6de25e6a-b433-4f08-941a-9666d215fe54 nodeName:}" failed. No retries permitted until 2026-07-11 01:06:44.826622891 +0000 UTC m=+9.158098431 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6de25e6a-b433-4f08-941a-9666d215fe54-metrics-certs") pod "network-metrics-daemon-4j8b6" (UID: "6de25e6a-b433-4f08-941a-9666d215fe54") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 11 01:06:40.827086 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:40.827065 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 11 01:06:40.827174 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:40.827096 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 11 01:06:40.827174 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:40.827109 2572 projected.go:196] Error preparing data for projected volume kube-api-access-nfl99 for pod openshift-network-diagnostics/network-check-target-m82rx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 11 01:06:40.827174 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:40.827165 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95087320-8e0c-484c-b734-3360faeff948-kube-api-access-nfl99 podName:95087320-8e0c-484c-b734-3360faeff948 nodeName:}" failed. No retries permitted until 2026-07-11 01:06:44.82714862 +0000 UTC m=+9.158624158 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-nfl99" (UniqueName: "kubernetes.io/projected/95087320-8e0c-484c-b734-3360faeff948-kube-api-access-nfl99") pod "network-check-target-m82rx" (UID: "95087320-8e0c-484c-b734-3360faeff948") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 11 01:06:40.827330 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:40.827232 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 11 01:06:40.827330 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:40.827270 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99a7e6d5-7736-4a0e-b4c2-12f925deb1b2-original-pull-secret podName:99a7e6d5-7736-4a0e-b4c2-12f925deb1b2 nodeName:}" failed. No retries permitted until 2026-07-11 01:06:44.82725807 +0000 UTC m=+9.158733610 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/99a7e6d5-7736-4a0e-b4c2-12f925deb1b2-original-pull-secret") pod "global-pull-secret-syncer-vmt4r" (UID: "99a7e6d5-7736-4a0e-b4c2-12f925deb1b2") : object "kube-system"/"original-pull-secret" not registered Jul 11 01:06:41.251057 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:41.250981 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4j8b6" Jul 11 01:06:41.251057 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:41.251009 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmt4r" Jul 11 01:06:41.251278 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:41.251121 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4j8b6" podUID="6de25e6a-b433-4f08-941a-9666d215fe54" Jul 11 01:06:41.251278 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:41.251232 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vmt4r" podUID="99a7e6d5-7736-4a0e-b4c2-12f925deb1b2" Jul 11 01:06:42.251334 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:42.251289 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m82rx" Jul 11 01:06:42.251781 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:42.251416 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m82rx" podUID="95087320-8e0c-484c-b734-3360faeff948" Jul 11 01:06:43.251450 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:43.251413 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4j8b6" Jul 11 01:06:43.251944 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:43.251539 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4j8b6" podUID="6de25e6a-b433-4f08-941a-9666d215fe54" Jul 11 01:06:43.252019 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:43.251966 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmt4r" Jul 11 01:06:43.252073 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:43.252048 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vmt4r" podUID="99a7e6d5-7736-4a0e-b4c2-12f925deb1b2" Jul 11 01:06:44.251156 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:44.251039 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m82rx" Jul 11 01:06:44.251328 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:44.251192 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m82rx" podUID="95087320-8e0c-484c-b734-3360faeff948" Jul 11 01:06:44.858474 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:44.858433 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfl99\" (UniqueName: \"kubernetes.io/projected/95087320-8e0c-484c-b734-3360faeff948-kube-api-access-nfl99\") pod \"network-check-target-m82rx\" (UID: \"95087320-8e0c-484c-b734-3360faeff948\") " pod="openshift-network-diagnostics/network-check-target-m82rx" Jul 11 01:06:44.858966 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:44.858493 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/99a7e6d5-7736-4a0e-b4c2-12f925deb1b2-original-pull-secret\") pod \"global-pull-secret-syncer-vmt4r\" (UID: \"99a7e6d5-7736-4a0e-b4c2-12f925deb1b2\") " pod="kube-system/global-pull-secret-syncer-vmt4r" Jul 11 01:06:44.858966 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:44.858523 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6de25e6a-b433-4f08-941a-9666d215fe54-metrics-certs\") pod \"network-metrics-daemon-4j8b6\" (UID: \"6de25e6a-b433-4f08-941a-9666d215fe54\") " pod="openshift-multus/network-metrics-daemon-4j8b6" Jul 11 01:06:44.858966 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:44.858653 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 11 01:06:44.858966 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:44.858732 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6de25e6a-b433-4f08-941a-9666d215fe54-metrics-certs podName:6de25e6a-b433-4f08-941a-9666d215fe54 nodeName:}" failed. No retries permitted until 2026-07-11 01:06:52.858711738 +0000 UTC m=+17.190187274 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6de25e6a-b433-4f08-941a-9666d215fe54-metrics-certs") pod "network-metrics-daemon-4j8b6" (UID: "6de25e6a-b433-4f08-941a-9666d215fe54") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 11 01:06:44.858966 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:44.858845 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 11 01:06:44.858966 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:44.858862 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 11 01:06:44.858966 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:44.858875 2572 projected.go:196] Error preparing data for projected volume kube-api-access-nfl99 for pod openshift-network-diagnostics/network-check-target-m82rx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 11 01:06:44.858966 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:44.858905 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 11 01:06:44.858966 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:44.858921 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95087320-8e0c-484c-b734-3360faeff948-kube-api-access-nfl99 podName:95087320-8e0c-484c-b734-3360faeff948 nodeName:}" failed. No retries permitted until 2026-07-11 01:06:52.85890933 +0000 UTC m=+17.190384857 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-nfl99" (UniqueName: "kubernetes.io/projected/95087320-8e0c-484c-b734-3360faeff948-kube-api-access-nfl99") pod "network-check-target-m82rx" (UID: "95087320-8e0c-484c-b734-3360faeff948") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 11 01:06:44.858966 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:44.858968 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99a7e6d5-7736-4a0e-b4c2-12f925deb1b2-original-pull-secret podName:99a7e6d5-7736-4a0e-b4c2-12f925deb1b2 nodeName:}" failed. No retries permitted until 2026-07-11 01:06:52.85895103 +0000 UTC m=+17.190426557 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/99a7e6d5-7736-4a0e-b4c2-12f925deb1b2-original-pull-secret") pod "global-pull-secret-syncer-vmt4r" (UID: "99a7e6d5-7736-4a0e-b4c2-12f925deb1b2") : object "kube-system"/"original-pull-secret" not registered Jul 11 01:06:45.251400 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:45.250861 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmt4r" Jul 11 01:06:45.251400 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:45.251006 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vmt4r" podUID="99a7e6d5-7736-4a0e-b4c2-12f925deb1b2" Jul 11 01:06:45.251400 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:45.251057 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4j8b6" Jul 11 01:06:45.251400 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:45.251184 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4j8b6" podUID="6de25e6a-b433-4f08-941a-9666d215fe54" Jul 11 01:06:46.253214 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:46.252739 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m82rx" Jul 11 01:06:46.253214 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:46.252860 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m82rx" podUID="95087320-8e0c-484c-b734-3360faeff948" Jul 11 01:06:47.251557 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:47.251520 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4j8b6" Jul 11 01:06:47.251745 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:47.251531 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmt4r" Jul 11 01:06:47.251745 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:47.251678 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4j8b6" podUID="6de25e6a-b433-4f08-941a-9666d215fe54" Jul 11 01:06:47.251866 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:47.251741 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vmt4r" podUID="99a7e6d5-7736-4a0e-b4c2-12f925deb1b2" Jul 11 01:06:48.250977 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:48.250875 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m82rx" Jul 11 01:06:48.251447 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:48.250988 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m82rx" podUID="95087320-8e0c-484c-b734-3360faeff948" Jul 11 01:06:49.251724 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:49.251621 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4j8b6" Jul 11 01:06:49.251724 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:49.251670 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmt4r" Jul 11 01:06:49.252229 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:49.251791 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4j8b6" podUID="6de25e6a-b433-4f08-941a-9666d215fe54" Jul 11 01:06:49.252229 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:49.251935 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vmt4r" podUID="99a7e6d5-7736-4a0e-b4c2-12f925deb1b2" Jul 11 01:06:50.251689 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:50.251653 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m82rx" Jul 11 01:06:50.251866 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:50.251799 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m82rx" podUID="95087320-8e0c-484c-b734-3360faeff948" Jul 11 01:06:51.251437 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:51.251397 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4j8b6" Jul 11 01:06:51.251601 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:51.251421 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmt4r" Jul 11 01:06:51.251601 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:51.251545 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4j8b6" podUID="6de25e6a-b433-4f08-941a-9666d215fe54" Jul 11 01:06:51.251601 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:51.251565 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vmt4r" podUID="99a7e6d5-7736-4a0e-b4c2-12f925deb1b2" Jul 11 01:06:52.253803 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:52.253775 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m82rx" Jul 11 01:06:52.254313 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:52.253879 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m82rx" podUID="95087320-8e0c-484c-b734-3360faeff948" Jul 11 01:06:52.919976 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:52.919936 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfl99\" (UniqueName: \"kubernetes.io/projected/95087320-8e0c-484c-b734-3360faeff948-kube-api-access-nfl99\") pod \"network-check-target-m82rx\" (UID: \"95087320-8e0c-484c-b734-3360faeff948\") " pod="openshift-network-diagnostics/network-check-target-m82rx" Jul 11 01:06:52.919976 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:52.919984 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/99a7e6d5-7736-4a0e-b4c2-12f925deb1b2-original-pull-secret\") pod \"global-pull-secret-syncer-vmt4r\" (UID: \"99a7e6d5-7736-4a0e-b4c2-12f925deb1b2\") " pod="kube-system/global-pull-secret-syncer-vmt4r" Jul 11 01:06:52.920279 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:52.920006 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6de25e6a-b433-4f08-941a-9666d215fe54-metrics-certs\") pod \"network-metrics-daemon-4j8b6\" (UID: \"6de25e6a-b433-4f08-941a-9666d215fe54\") " pod="openshift-multus/network-metrics-daemon-4j8b6" Jul 11 01:06:52.920279 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:52.920111 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 11 01:06:52.920279 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:52.920118 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 11 01:06:52.920279 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:52.920164 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 11 01:06:52.920279 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:52.920187 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 11 01:06:52.920279 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:52.920201 2572 projected.go:196] Error preparing data for projected volume kube-api-access-nfl99 for pod openshift-network-diagnostics/network-check-target-m82rx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 11 01:06:52.920279 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:52.920169 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6de25e6a-b433-4f08-941a-9666d215fe54-metrics-certs podName:6de25e6a-b433-4f08-941a-9666d215fe54 nodeName:}" failed. No retries permitted until 2026-07-11 01:07:08.920155552 +0000 UTC m=+33.251631074 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6de25e6a-b433-4f08-941a-9666d215fe54-metrics-certs") pod "network-metrics-daemon-4j8b6" (UID: "6de25e6a-b433-4f08-941a-9666d215fe54") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 11 01:06:52.920279 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:52.920256 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99a7e6d5-7736-4a0e-b4c2-12f925deb1b2-original-pull-secret podName:99a7e6d5-7736-4a0e-b4c2-12f925deb1b2 nodeName:}" failed. No retries permitted until 2026-07-11 01:07:08.920240122 +0000 UTC m=+33.251715656 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/99a7e6d5-7736-4a0e-b4c2-12f925deb1b2-original-pull-secret") pod "global-pull-secret-syncer-vmt4r" (UID: "99a7e6d5-7736-4a0e-b4c2-12f925deb1b2") : object "kube-system"/"original-pull-secret" not registered Jul 11 01:06:52.920279 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:52.920275 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95087320-8e0c-484c-b734-3360faeff948-kube-api-access-nfl99 podName:95087320-8e0c-484c-b734-3360faeff948 nodeName:}" failed. No retries permitted until 2026-07-11 01:07:08.92026371 +0000 UTC m=+33.251739238 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-nfl99" (UniqueName: "kubernetes.io/projected/95087320-8e0c-484c-b734-3360faeff948-kube-api-access-nfl99") pod "network-check-target-m82rx" (UID: "95087320-8e0c-484c-b734-3360faeff948") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 11 01:06:53.251996 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:53.251897 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4j8b6" Jul 11 01:06:53.252156 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:53.252009 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4j8b6" podUID="6de25e6a-b433-4f08-941a-9666d215fe54" Jul 11 01:06:53.252156 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:53.252075 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmt4r" Jul 11 01:06:53.252251 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:53.252162 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vmt4r" podUID="99a7e6d5-7736-4a0e-b4c2-12f925deb1b2" Jul 11 01:06:54.251769 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:54.251732 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m82rx" Jul 11 01:06:54.252247 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:54.251862 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m82rx" podUID="95087320-8e0c-484c-b734-3360faeff948" Jul 11 01:06:55.251898 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:55.251861 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmt4r" Jul 11 01:06:55.252301 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:55.251861 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4j8b6" Jul 11 01:06:55.252301 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:55.251987 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vmt4r" podUID="99a7e6d5-7736-4a0e-b4c2-12f925deb1b2" Jul 11 01:06:55.252301 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:55.252104 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4j8b6" podUID="6de25e6a-b433-4f08-941a-9666d215fe54" Jul 11 01:06:56.252365 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:56.252331 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m82rx" Jul 11 01:06:56.252791 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:56.252424 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m82rx" podUID="95087320-8e0c-484c-b734-3360faeff948" Jul 11 01:06:57.251326 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:57.251291 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4j8b6" Jul 11 01:06:57.251462 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:57.251298 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmt4r" Jul 11 01:06:57.251462 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:57.251404 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4j8b6" podUID="6de25e6a-b433-4f08-941a-9666d215fe54" Jul 11 01:06:57.251521 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:57.251482 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vmt4r" podUID="99a7e6d5-7736-4a0e-b4c2-12f925deb1b2" Jul 11 01:06:58.254676 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:58.254484 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m82rx" Jul 11 01:06:58.255401 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:58.254770 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m82rx" podUID="95087320-8e0c-484c-b734-3360faeff948" Jul 11 01:06:58.574222 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:58.574183 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-46bl6" event={"ID":"ec166c39-ac6d-4182-a8d6-fb0a34eb1915","Type":"ContainerStarted","Data":"68679153d7bd32ee75de8a1fb620bdcbd1efb69284c57b3dcd26f2872f2f341e"} Jul 11 01:06:58.575582 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:58.575553 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-b5t7g" event={"ID":"78a7b886-157e-4df7-9599-c86dfb672085","Type":"ContainerStarted","Data":"643a6bd69a848507cced3c74c1156d6c308b7cf58baf6857e9b9fe95ec183f01"} Jul 11 01:06:58.576840 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:58.576814 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-457jl" event={"ID":"4f51f053-17f3-44cc-8b0e-0ca541b7370e","Type":"ContainerStarted","Data":"cf26a57276558aa70e2cda66af0d6c734f0113b10e82b8e7b238ecbc2123d103"} Jul 11 01:06:58.578264 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:58.578242 2572 generic.go:356] "Generic (PLEG): container finished" podID="a817a6e0-4aaa-40d0-95f4-5daeb4481842" containerID="b74258d4a29441742c8c26c8b737c6360a974ce572727467b481b4409ca6ac1f" exitCode=0 Jul 11 01:06:58.578346 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:58.578305 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tlq4c" event={"ID":"a817a6e0-4aaa-40d0-95f4-5daeb4481842","Type":"ContainerDied","Data":"b74258d4a29441742c8c26c8b737c6360a974ce572727467b481b4409ca6ac1f"} Jul 11 01:06:58.579678 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:58.579665 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-f6sd8" event={"ID":"80e2a675-663f-4959-89d2-c97483b65e4c","Type":"ContainerStarted","Data":"49e4e26c73d8e5b02773e4ddd390b8a9649a7e9ac63344f59bc9ae453255bf12"} Jul 11 01:06:58.580968 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:58.580914 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-161.ec2.internal" event={"ID":"7d6d27db974b8b86e3da7428c71f54c4","Type":"ContainerStarted","Data":"7533490fcfa05b89a900b5e0425803f54355eebf4d626c97501257c68935edca"} Jul 11 01:06:58.582301 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:58.582280 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ff2g5" event={"ID":"db99d519-c8a2-40f5-b238-123774baa78a","Type":"ContainerStarted","Data":"bfbbd671bf923e75e42c995f50b148a4b10cf1b58f61b2fca2f54d1b1316fd2c"} Jul 11 01:06:58.583616 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:58.583597 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jjd8d" event={"ID":"e1e3c11c-1b4f-4101-8df4-2e9f1d13a67c","Type":"ContainerStarted","Data":"a826c0fbfb4388543f417145782753cd7bad27b8fd498ccf3ea4f5e47ea9d709"} Jul 11 01:06:58.586376 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:58.586357 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hww5x" event={"ID":"bc650005-4617-49c3-a87c-ccd4c5d14b6f","Type":"ContainerStarted","Data":"e59616de9eee05141a797483f3527199a69b442ec1e77230af07fe1f4d4e4742"} Jul 11 01:06:58.586474 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:58.586418 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hww5x" event={"ID":"bc650005-4617-49c3-a87c-ccd4c5d14b6f","Type":"ContainerStarted","Data":"d25626e43c7bb3f4762cf0cf0d71017c2cefb09f4688ead1e64911050a801456"} Jul 11 01:06:58.586474 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:58.586452 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hww5x" event={"ID":"bc650005-4617-49c3-a87c-ccd4c5d14b6f","Type":"ContainerStarted","Data":"92987e0dbf569cc5e676b6346a0da1d0990ac23991aa6556203fe5285c552596"} Jul 11 01:06:58.586583 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:58.586492 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hww5x" event={"ID":"bc650005-4617-49c3-a87c-ccd4c5d14b6f","Type":"ContainerStarted","Data":"9ae96711ec64e06f65eb4166db7029e74458de40785d814e2a1e603abb9c01f0"} Jul 11 01:06:58.586583 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:58.586520 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hww5x" event={"ID":"bc650005-4617-49c3-a87c-ccd4c5d14b6f","Type":"ContainerStarted","Data":"58657fc03dc865ecd41f59a31fd7fd3fed4575708ac76abc2a9af368264e8b7c"} Jul 11 01:06:58.586583 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:58.586559 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hww5x" event={"ID":"bc650005-4617-49c3-a87c-ccd4c5d14b6f","Type":"ContainerStarted","Data":"833a5a908ee653d8e7ee6ee8190d9499c094bdb979a78c6977176ca4193db278"} Jul 11 01:06:58.587833 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:58.587813 2572 generic.go:356] "Generic (PLEG): container finished" podID="ddc18782af4676c4d2733345c70ab795" containerID="fb8d930bd2ee9e913d520571a80b11c23fea012439369b4bdeb7445e5e028d6a" exitCode=0 Jul 11 01:06:58.587922 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:58.587841 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-161.ec2.internal" event={"ID":"ddc18782af4676c4d2733345c70ab795","Type":"ContainerDied","Data":"fb8d930bd2ee9e913d520571a80b11c23fea012439369b4bdeb7445e5e028d6a"} Jul 11 01:06:58.587922 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:58.587847 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-46bl6" podStartSLOduration=2.8094304599999997 podStartE2EDuration="22.587835072s" totalImagesPullingTime="19.778404612s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 01:06:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:06:58.587294808 +0000 UTC m=+22.918770353" watchObservedRunningTime="2026-07-11 01:06:58.587835072 +0000 UTC m=+22.919310616" Jul 11 01:06:58.612441 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:58.612402 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-f6sd8" podStartSLOduration=2.681067124 podStartE2EDuration="22.612389286s" totalImagesPullingTime="19.931322162s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:06:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:06:58.611910597 +0000 UTC m=+22.943386141" watchObservedRunningTime="2026-07-11 01:06:58.612389286 +0000 UTC m=+22.943864829" Jul 11 01:06:58.612511 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:58.612471 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-161.ec2.internal" podStartSLOduration=22.612467402 podStartE2EDuration="22.612467402s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 01:06:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:06:58.599311703 +0000 UTC m=+22.930787247" watchObservedRunningTime="2026-07-11 01:06:58.612467402 +0000 UTC m=+22.943942949" Jul 11 01:06:58.645510 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:58.645470 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-ff2g5" podStartSLOduration=2.852818444 podStartE2EDuration="22.645454829s" totalImagesPullingTime="19.792636385s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 01:06:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:06:58.645029657 +0000 UTC m=+22.976505212" watchObservedRunningTime="2026-07-11 01:06:58.645454829 +0000 UTC m=+22.976930373" Jul 11 01:06:58.659339 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:58.659297 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-b5t7g" podStartSLOduration=2.818840983 podStartE2EDuration="22.659285628s" totalImagesPullingTime="19.840444645s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 01:06:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:06:58.658827029 +0000 UTC m=+22.990302573" watchObservedRunningTime="2026-07-11 01:06:58.659285628 +0000 UTC m=+22.990761172" Jul 11 01:06:58.672859 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:58.672824 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-jjd8d" podStartSLOduration=2.875673005 podStartE2EDuration="22.672809387s" totalImagesPullingTime="19.797136382s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 01:06:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:06:58.672634848 +0000 UTC m=+23.004110387" watchObservedRunningTime="2026-07-11 01:06:58.672809387 +0000 UTC m=+23.004284932" Jul 11 01:06:59.251170 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:59.251143 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4j8b6" Jul 11 01:06:59.251170 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:59.251162 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmt4r" Jul 11 01:06:59.251506 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:59.251267 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4j8b6" podUID="6de25e6a-b433-4f08-941a-9666d215fe54" Jul 11 01:06:59.251506 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:06:59.251404 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vmt4r" podUID="99a7e6d5-7736-4a0e-b4c2-12f925deb1b2" Jul 11 01:06:59.544468 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:59.544443 2572 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 11 01:06:59.591898 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:59.591864 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-457jl" event={"ID":"4f51f053-17f3-44cc-8b0e-0ca541b7370e","Type":"ContainerStarted","Data":"45f89c6bde3e9f08b10116a22eb18895b28d0a30d9e5365f04bbc40cfdfe7a4e"} Jul 11 01:06:59.593431 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:59.593381 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-t2ztp" event={"ID":"5d4af8ec-f681-4671-939b-db461fb0dc06","Type":"ContainerStarted","Data":"ce0686df2e92f9b073edb99ffa66de5ff5d46373672e5d25655a94db8e19f31f"} Jul 11 01:06:59.595295 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:59.595267 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-161.ec2.internal" event={"ID":"ddc18782af4676c4d2733345c70ab795","Type":"ContainerStarted","Data":"bc27a6f218e77b2946c0883f1701a29322748f543e25ccf21c6bbf070f3824bd"} Jul 11 01:06:59.607030 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:59.606982 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-t2ztp" podStartSLOduration=3.717765708 podStartE2EDuration="23.60696417s" totalImagesPullingTime="19.889198462s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 01:06:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:06:59.606937203 +0000 UTC m=+23.938412772" watchObservedRunningTime="2026-07-11 01:06:59.60696417 +0000 UTC m=+23.938439715" Jul 11 01:06:59.620568 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:06:59.620525 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-161.ec2.internal" podStartSLOduration=23.620512 podStartE2EDuration="23.620512s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 01:06:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:06:59.620378945 +0000 UTC m=+23.951854511" watchObservedRunningTime="2026-07-11 01:06:59.620512 +0000 UTC m=+23.951987543" Jul 11 01:07:00.062531 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:00.062501 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-f6sd8" Jul 11 01:07:00.063086 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:00.063066 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-f6sd8" Jul 11 01:07:00.158025 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:00.157924 2572 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-11T01:06:59.544464708Z","UUID":"c8739212-9f8a-4926-874f-5ced42547c09","Handler":null,"Name":"","Endpoint":""} Jul 11 01:07:00.160349 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:00.160326 2572 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 11 01:07:00.160494 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:00.160408 2572 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 11 01:07:00.251133 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:00.251104 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m82rx" Jul 11 01:07:00.251314 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:07:00.251231 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m82rx" podUID="95087320-8e0c-484c-b734-3360faeff948" Jul 11 01:07:01.252027 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:01.251836 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4j8b6" Jul 11 01:07:01.252473 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:01.251868 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmt4r" Jul 11 01:07:01.252473 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:07:01.252144 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4j8b6" podUID="6de25e6a-b433-4f08-941a-9666d215fe54" Jul 11 01:07:01.252473 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:07:01.252173 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vmt4r" podUID="99a7e6d5-7736-4a0e-b4c2-12f925deb1b2" Jul 11 01:07:01.601918 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:01.601822 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-457jl" event={"ID":"4f51f053-17f3-44cc-8b0e-0ca541b7370e","Type":"ContainerStarted","Data":"20920d184250d4b1f7b41ee717900e3504a3fffe0c4ac18a34c62e1bcdb0f621"} Jul 11 01:07:01.605751 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:01.605717 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hww5x" event={"ID":"bc650005-4617-49c3-a87c-ccd4c5d14b6f","Type":"ContainerStarted","Data":"cf52fdb4c03cb4f2bf8a3d42279115f9880c1a64f1a494a5762942a2eaa8719b"} Jul 11 01:07:01.605751 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:01.605752 2572 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 11 01:07:01.618742 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:01.618670 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-457jl" podStartSLOduration=3.17268612 podStartE2EDuration="25.618654424s" totalImagesPullingTime="22.445968304s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 01:06:36 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:07:01.61812586 +0000 UTC m=+25.949601405" watchObservedRunningTime="2026-07-11 01:07:01.618654424 +0000 UTC m=+25.950129968" Jul 11 01:07:02.251377 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:02.251344 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m82rx" Jul 11 01:07:02.251564 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:07:02.251469 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m82rx" podUID="95087320-8e0c-484c-b734-3360faeff948" Jul 11 01:07:03.251851 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:03.251822 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4j8b6" Jul 11 01:07:03.252408 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:03.251835 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmt4r" Jul 11 01:07:03.252408 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:07:03.251953 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4j8b6" podUID="6de25e6a-b433-4f08-941a-9666d215fe54" Jul 11 01:07:03.252408 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:07:03.251991 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vmt4r" podUID="99a7e6d5-7736-4a0e-b4c2-12f925deb1b2" Jul 11 01:07:03.613336 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:03.613084 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hww5x" event={"ID":"bc650005-4617-49c3-a87c-ccd4c5d14b6f","Type":"ContainerStarted","Data":"fad909bf9e4c098005490c5940b8675f3a0dca9dcb5ed80ae2ea93824468884a"} Jul 11 01:07:03.613508 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:03.613366 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hww5x" Jul 11 01:07:03.613508 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:03.613421 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hww5x" Jul 11 01:07:03.614892 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:03.614871 2572 generic.go:356] "Generic (PLEG): container finished" podID="a817a6e0-4aaa-40d0-95f4-5daeb4481842" containerID="22d9b00b0ed5d69a02cfbf96d9f7698ad58915c959d182e4a681babd0e3e1055" exitCode=0 Jul 11 01:07:03.615009 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:03.614902 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tlq4c" event={"ID":"a817a6e0-4aaa-40d0-95f4-5daeb4481842","Type":"ContainerDied","Data":"22d9b00b0ed5d69a02cfbf96d9f7698ad58915c959d182e4a681babd0e3e1055"} Jul 11 01:07:03.629510 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:03.629487 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hww5x" Jul 11 01:07:03.638969 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:03.638925 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-hww5x" podStartSLOduration=7.702585761 podStartE2EDuration="27.638910566s" totalImagesPullingTime="19.936324805s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 01:06:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:07:03.638433183 +0000 UTC m=+27.969908728" watchObservedRunningTime="2026-07-11 01:07:03.638910566 +0000 UTC m=+27.970386110" Jul 11 01:07:04.251224 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:04.251188 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m82rx" Jul 11 01:07:04.251392 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:07:04.251304 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m82rx" podUID="95087320-8e0c-484c-b734-3360faeff948" Jul 11 01:07:04.617455 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:04.617382 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hww5x" Jul 11 01:07:04.632434 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:04.632409 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hww5x" Jul 11 01:07:05.251450 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:05.251226 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vmt4r"] Jul 11 01:07:05.251677 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:05.251591 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4j8b6" Jul 11 01:07:05.251750 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:05.251591 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmt4r" Jul 11 01:07:05.251750 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:07:05.251718 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4j8b6" podUID="6de25e6a-b433-4f08-941a-9666d215fe54" Jul 11 01:07:05.251826 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:07:05.251757 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vmt4r" podUID="99a7e6d5-7736-4a0e-b4c2-12f925deb1b2" Jul 11 01:07:05.254267 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:05.254238 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-m82rx"] Jul 11 01:07:05.254379 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:05.254327 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m82rx" Jul 11 01:07:05.254429 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:07:05.254411 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m82rx" podUID="95087320-8e0c-484c-b734-3360faeff948" Jul 11 01:07:05.254838 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:05.254820 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4j8b6"] Jul 11 01:07:05.620844 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:05.620755 2572 generic.go:356] "Generic (PLEG): container finished" podID="a817a6e0-4aaa-40d0-95f4-5daeb4481842" containerID="af7d404d969af348899538e646685ba5f77c10cacb94b915117b56368323fded" exitCode=0 Jul 11 01:07:05.621321 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:05.620850 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4j8b6" Jul 11 01:07:05.621321 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:05.620857 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tlq4c" event={"ID":"a817a6e0-4aaa-40d0-95f4-5daeb4481842","Type":"ContainerDied","Data":"af7d404d969af348899538e646685ba5f77c10cacb94b915117b56368323fded"} Jul 11 01:07:05.621321 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:07:05.621076 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4j8b6" podUID="6de25e6a-b433-4f08-941a-9666d215fe54" Jul 11 01:07:06.250479 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:06.250450 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-f6sd8" Jul 11 01:07:06.250662 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:06.250615 2572 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 11 01:07:06.253505 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:06.253485 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-f6sd8" Jul 11 01:07:07.251923 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:07.251896 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmt4r" Jul 11 01:07:07.252670 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:07.251894 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m82rx" Jul 11 01:07:07.252670 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:07:07.252026 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vmt4r" podUID="99a7e6d5-7736-4a0e-b4c2-12f925deb1b2" Jul 11 01:07:07.252670 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:07.251894 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4j8b6" Jul 11 01:07:07.252670 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:07:07.252112 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m82rx" podUID="95087320-8e0c-484c-b734-3360faeff948" Jul 11 01:07:07.252670 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:07:07.252148 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4j8b6" podUID="6de25e6a-b433-4f08-941a-9666d215fe54" Jul 11 01:07:07.627360 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:07.627280 2572 generic.go:356] "Generic (PLEG): container finished" podID="a817a6e0-4aaa-40d0-95f4-5daeb4481842" containerID="a9b064f95435493ea0b0ba523164ad83de6e0bd87e247590f11c9e26e7a35500" exitCode=0 Jul 11 01:07:07.627360 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:07.627344 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tlq4c" event={"ID":"a817a6e0-4aaa-40d0-95f4-5daeb4481842","Type":"ContainerDied","Data":"a9b064f95435493ea0b0ba523164ad83de6e0bd87e247590f11c9e26e7a35500"} Jul 11 01:07:08.940724 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:08.940680 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfl99\" (UniqueName: \"kubernetes.io/projected/95087320-8e0c-484c-b734-3360faeff948-kube-api-access-nfl99\") pod \"network-check-target-m82rx\" (UID: \"95087320-8e0c-484c-b734-3360faeff948\") " pod="openshift-network-diagnostics/network-check-target-m82rx" Jul 11 01:07:08.941203 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:08.940733 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/99a7e6d5-7736-4a0e-b4c2-12f925deb1b2-original-pull-secret\") pod \"global-pull-secret-syncer-vmt4r\" (UID: \"99a7e6d5-7736-4a0e-b4c2-12f925deb1b2\") " pod="kube-system/global-pull-secret-syncer-vmt4r" Jul 11 01:07:08.941203 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:08.940753 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6de25e6a-b433-4f08-941a-9666d215fe54-metrics-certs\") pod \"network-metrics-daemon-4j8b6\" (UID: \"6de25e6a-b433-4f08-941a-9666d215fe54\") " pod="openshift-multus/network-metrics-daemon-4j8b6" Jul 11 01:07:08.941203 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:07:08.940837 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 11 01:07:08.941203 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:07:08.940852 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 11 01:07:08.941203 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:07:08.940874 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 11 01:07:08.941203 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:07:08.940884 2572 projected.go:196] Error preparing data for projected volume kube-api-access-nfl99 for pod openshift-network-diagnostics/network-check-target-m82rx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 11 01:07:08.941203 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:07:08.940899 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6de25e6a-b433-4f08-941a-9666d215fe54-metrics-certs podName:6de25e6a-b433-4f08-941a-9666d215fe54 nodeName:}" failed. No retries permitted until 2026-07-11 01:07:40.94088518 +0000 UTC m=+65.272360702 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6de25e6a-b433-4f08-941a-9666d215fe54-metrics-certs") pod "network-metrics-daemon-4j8b6" (UID: "6de25e6a-b433-4f08-941a-9666d215fe54") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 11 01:07:08.941203 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:07:08.940910 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 11 01:07:08.941203 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:07:08.940924 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95087320-8e0c-484c-b734-3360faeff948-kube-api-access-nfl99 podName:95087320-8e0c-484c-b734-3360faeff948 nodeName:}" failed. No retries permitted until 2026-07-11 01:07:40.940911763 +0000 UTC m=+65.272387311 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-nfl99" (UniqueName: "kubernetes.io/projected/95087320-8e0c-484c-b734-3360faeff948-kube-api-access-nfl99") pod "network-check-target-m82rx" (UID: "95087320-8e0c-484c-b734-3360faeff948") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 11 01:07:08.941203 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:07:08.940964 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99a7e6d5-7736-4a0e-b4c2-12f925deb1b2-original-pull-secret podName:99a7e6d5-7736-4a0e-b4c2-12f925deb1b2 nodeName:}" failed. No retries permitted until 2026-07-11 01:07:40.940949723 +0000 UTC m=+65.272425246 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/99a7e6d5-7736-4a0e-b4c2-12f925deb1b2-original-pull-secret") pod "global-pull-secret-syncer-vmt4r" (UID: "99a7e6d5-7736-4a0e-b4c2-12f925deb1b2") : object "kube-system"/"original-pull-secret" not registered Jul 11 01:07:09.251425 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:09.251390 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmt4r" Jul 11 01:07:09.251425 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:09.251429 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4j8b6" Jul 11 01:07:09.251673 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:09.251507 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m82rx" Jul 11 01:07:09.251673 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:07:09.251522 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vmt4r" podUID="99a7e6d5-7736-4a0e-b4c2-12f925deb1b2" Jul 11 01:07:09.251673 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:07:09.251600 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m82rx" podUID="95087320-8e0c-484c-b734-3360faeff948" Jul 11 01:07:09.251885 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:07:09.251676 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4j8b6" podUID="6de25e6a-b433-4f08-941a-9666d215fe54" Jul 11 01:07:10.403076 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:10.403001 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-161.ec2.internal" event="NodeReady" Jul 11 01:07:10.403506 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:10.403157 2572 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 11 01:07:10.447039 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:10.447006 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-m8drm"] Jul 11 01:07:10.462070 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:10.462036 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-jvzch"] Jul 11 01:07:10.462232 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:10.462196 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-m8drm" Jul 11 01:07:10.465862 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:10.465425 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 11 01:07:10.465862 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:10.465673 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 11 01:07:10.466125 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:10.466103 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nzrhh\"" Jul 11 01:07:10.476044 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:10.476024 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-m8drm"] Jul 11 01:07:10.476134 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:10.476066 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jvzch"] Jul 11 01:07:10.476178 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:10.476157 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jvzch" Jul 11 01:07:10.478714 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:10.478681 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-mzv2k\"" Jul 11 01:07:10.478815 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:10.478694 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 11 01:07:10.478815 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:10.478733 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 11 01:07:10.478815 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:10.478681 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 11 01:07:10.552320 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:10.552284 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qntq5\" (UniqueName: \"kubernetes.io/projected/a252a55d-e8b2-48a9-806e-8f1bae252f2a-kube-api-access-qntq5\") pod \"ingress-canary-jvzch\" (UID: \"a252a55d-e8b2-48a9-806e-8f1bae252f2a\") " pod="openshift-ingress-canary/ingress-canary-jvzch" Jul 11 01:07:10.552320 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:10.552322 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64-config-volume\") pod \"dns-default-m8drm\" (UID: \"dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64\") " pod="openshift-dns/dns-default-m8drm" Jul 11 01:07:10.552518 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:10.552352 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a252a55d-e8b2-48a9-806e-8f1bae252f2a-cert\") pod \"ingress-canary-jvzch\" (UID: \"a252a55d-e8b2-48a9-806e-8f1bae252f2a\") " pod="openshift-ingress-canary/ingress-canary-jvzch" Jul 11 01:07:10.552518 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:10.552371 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5lk2\" (UniqueName: \"kubernetes.io/projected/dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64-kube-api-access-s5lk2\") pod \"dns-default-m8drm\" (UID: \"dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64\") " pod="openshift-dns/dns-default-m8drm" Jul 11 01:07:10.552518 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:10.552389 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64-tmp-dir\") pod \"dns-default-m8drm\" (UID: \"dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64\") " pod="openshift-dns/dns-default-m8drm" Jul 11 01:07:10.552518 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:10.552426 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64-metrics-tls\") pod \"dns-default-m8drm\" (UID: \"dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64\") " pod="openshift-dns/dns-default-m8drm" Jul 11 01:07:10.653410 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:10.653324 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qntq5\" (UniqueName: \"kubernetes.io/projected/a252a55d-e8b2-48a9-806e-8f1bae252f2a-kube-api-access-qntq5\") pod \"ingress-canary-jvzch\" (UID: \"a252a55d-e8b2-48a9-806e-8f1bae252f2a\") " pod="openshift-ingress-canary/ingress-canary-jvzch" Jul 11 01:07:10.653410 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:10.653359 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64-config-volume\") pod \"dns-default-m8drm\" (UID: \"dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64\") " pod="openshift-dns/dns-default-m8drm" Jul 11 01:07:10.653410 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:10.653385 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a252a55d-e8b2-48a9-806e-8f1bae252f2a-cert\") pod \"ingress-canary-jvzch\" (UID: \"a252a55d-e8b2-48a9-806e-8f1bae252f2a\") " pod="openshift-ingress-canary/ingress-canary-jvzch" Jul 11 01:07:10.653410 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:10.653411 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5lk2\" (UniqueName: \"kubernetes.io/projected/dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64-kube-api-access-s5lk2\") pod \"dns-default-m8drm\" (UID: \"dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64\") " pod="openshift-dns/dns-default-m8drm" Jul 11 01:07:10.653744 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:10.653550 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64-tmp-dir\") pod \"dns-default-m8drm\" (UID: \"dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64\") " pod="openshift-dns/dns-default-m8drm" Jul 11 01:07:10.653744 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:10.653610 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64-metrics-tls\") pod \"dns-default-m8drm\" (UID: \"dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64\") " pod="openshift-dns/dns-default-m8drm" Jul 11 01:07:10.653744 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:07:10.653733 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 11 01:07:10.653907 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:07:10.653800 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64-metrics-tls podName:dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64 nodeName:}" failed. No retries permitted until 2026-07-11 01:07:11.153778153 +0000 UTC m=+35.485253695 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64-metrics-tls") pod "dns-default-m8drm" (UID: "dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64") : secret "dns-default-metrics-tls" not found Jul 11 01:07:10.653907 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:10.653852 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64-tmp-dir\") pod \"dns-default-m8drm\" (UID: \"dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64\") " pod="openshift-dns/dns-default-m8drm" Jul 11 01:07:10.654322 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:10.654129 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64-config-volume\") pod \"dns-default-m8drm\" (UID: \"dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64\") " pod="openshift-dns/dns-default-m8drm" Jul 11 01:07:10.658321 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:10.658297 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a252a55d-e8b2-48a9-806e-8f1bae252f2a-cert\") pod \"ingress-canary-jvzch\" (UID: \"a252a55d-e8b2-48a9-806e-8f1bae252f2a\") " pod="openshift-ingress-canary/ingress-canary-jvzch" Jul 11 01:07:10.661565 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:10.661541 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5lk2\" (UniqueName: \"kubernetes.io/projected/dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64-kube-api-access-s5lk2\") pod \"dns-default-m8drm\" (UID: \"dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64\") " pod="openshift-dns/dns-default-m8drm" Jul 11 01:07:10.661663 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:10.661596 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qntq5\" (UniqueName: \"kubernetes.io/projected/a252a55d-e8b2-48a9-806e-8f1bae252f2a-kube-api-access-qntq5\") pod \"ingress-canary-jvzch\" (UID: \"a252a55d-e8b2-48a9-806e-8f1bae252f2a\") " pod="openshift-ingress-canary/ingress-canary-jvzch" Jul 11 01:07:10.786255 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:10.786222 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jvzch" Jul 11 01:07:11.157429 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:11.157400 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64-metrics-tls\") pod \"dns-default-m8drm\" (UID: \"dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64\") " pod="openshift-dns/dns-default-m8drm" Jul 11 01:07:11.157613 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:07:11.157571 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 11 01:07:11.157657 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:07:11.157647 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64-metrics-tls podName:dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64 nodeName:}" failed. No retries permitted until 2026-07-11 01:07:12.157624183 +0000 UTC m=+36.489099715 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64-metrics-tls") pod "dns-default-m8drm" (UID: "dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64") : secret "dns-default-metrics-tls" not found Jul 11 01:07:11.251773 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:11.251739 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m82rx" Jul 11 01:07:11.251773 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:11.251770 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4j8b6" Jul 11 01:07:11.252001 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:11.251742 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmt4r" Jul 11 01:07:11.255850 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:11.255711 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 11 01:07:11.255850 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:11.255723 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 11 01:07:11.255850 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:11.255739 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8v8tm\"" Jul 11 01:07:11.255850 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:11.255760 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8ms55\"" Jul 11 01:07:11.256123 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:11.255915 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 11 01:07:11.256174 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:11.256122 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 11 01:07:12.166963 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:12.166928 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64-metrics-tls\") pod \"dns-default-m8drm\" (UID: \"dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64\") " pod="openshift-dns/dns-default-m8drm" Jul 11 01:07:12.167304 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:07:12.167060 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 11 01:07:12.167304 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:07:12.167112 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64-metrics-tls podName:dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64 nodeName:}" failed. No retries permitted until 2026-07-11 01:07:14.167098715 +0000 UTC m=+38.498574237 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64-metrics-tls") pod "dns-default-m8drm" (UID: "dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64") : secret "dns-default-metrics-tls" not found Jul 11 01:07:12.263758 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:12.263730 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jvzch"] Jul 11 01:07:12.368788 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:07:12.368717 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda252a55d_e8b2_48a9_806e_8f1bae252f2a.slice/crio-3de4d18f090e12b3755fb779cbd3cae46062530dbe418308509b71ae0da96e44 WatchSource:0}: Error finding container 3de4d18f090e12b3755fb779cbd3cae46062530dbe418308509b71ae0da96e44: Status 404 returned error can't find the container with id 3de4d18f090e12b3755fb779cbd3cae46062530dbe418308509b71ae0da96e44 Jul 11 01:07:12.640398 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:12.640369 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jvzch" event={"ID":"a252a55d-e8b2-48a9-806e-8f1bae252f2a","Type":"ContainerStarted","Data":"3de4d18f090e12b3755fb779cbd3cae46062530dbe418308509b71ae0da96e44"} Jul 11 01:07:12.642818 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:12.642792 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tlq4c" event={"ID":"a817a6e0-4aaa-40d0-95f4-5daeb4481842","Type":"ContainerStarted","Data":"cfbe5b7c162567bb0e93fa84680eed82ba94d45f428dce1e241bf43765a039e5"} Jul 11 01:07:13.649248 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:13.649025 2572 generic.go:356] "Generic (PLEG): container finished" podID="a817a6e0-4aaa-40d0-95f4-5daeb4481842" containerID="cfbe5b7c162567bb0e93fa84680eed82ba94d45f428dce1e241bf43765a039e5" exitCode=0 Jul 11 01:07:13.649655 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:13.649111 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tlq4c" event={"ID":"a817a6e0-4aaa-40d0-95f4-5daeb4481842","Type":"ContainerDied","Data":"cfbe5b7c162567bb0e93fa84680eed82ba94d45f428dce1e241bf43765a039e5"} Jul 11 01:07:14.183302 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:14.183264 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64-metrics-tls\") pod \"dns-default-m8drm\" (UID: \"dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64\") " pod="openshift-dns/dns-default-m8drm" Jul 11 01:07:14.183480 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:07:14.183460 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 11 01:07:14.183552 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:07:14.183539 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64-metrics-tls podName:dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64 nodeName:}" failed. No retries permitted until 2026-07-11 01:07:18.183518589 +0000 UTC m=+42.514994128 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64-metrics-tls") pod "dns-default-m8drm" (UID: "dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64") : secret "dns-default-metrics-tls" not found Jul 11 01:07:14.656142 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:14.656105 2572 generic.go:356] "Generic (PLEG): container finished" podID="a817a6e0-4aaa-40d0-95f4-5daeb4481842" containerID="eae00ab2667d93c23b7c939d16764beb26a5f129b1a1027e4515d5e0d598eca0" exitCode=0 Jul 11 01:07:14.656577 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:14.656153 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tlq4c" event={"ID":"a817a6e0-4aaa-40d0-95f4-5daeb4481842","Type":"ContainerDied","Data":"eae00ab2667d93c23b7c939d16764beb26a5f129b1a1027e4515d5e0d598eca0"} Jul 11 01:07:15.660377 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:15.660340 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jvzch" event={"ID":"a252a55d-e8b2-48a9-806e-8f1bae252f2a","Type":"ContainerStarted","Data":"ad1bcd9e6eb532afafa496c6f259fd909432c014d764d243ab4c24a2aeff231c"} Jul 11 01:07:15.663524 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:15.663495 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tlq4c" event={"ID":"a817a6e0-4aaa-40d0-95f4-5daeb4481842","Type":"ContainerStarted","Data":"6a16a1674cb42c07b18d143e9ba69daef02fe0dda9904b750fcb5402a6927fde"} Jul 11 01:07:15.675914 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:15.675867 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-jvzch" podStartSLOduration=3.065161185 podStartE2EDuration="5.675851005s" totalImagesPullingTime="2.61068982s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:07:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:07:15.675079284 +0000 UTC m=+40.006554844" watchObservedRunningTime="2026-07-11 01:07:15.675851005 +0000 UTC m=+40.007326540" Jul 11 01:07:15.696438 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:15.694788 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-tlq4c" podStartSLOduration=7.983198083 podStartE2EDuration="39.694766177s" totalImagesPullingTime="31.711568094s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 01:06:36 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:07:15.694086955 +0000 UTC m=+40.025562500" watchObservedRunningTime="2026-07-11 01:07:15.694766177 +0000 UTC m=+40.026241722" Jul 11 01:07:18.214407 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:18.214370 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64-metrics-tls\") pod \"dns-default-m8drm\" (UID: \"dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64\") " pod="openshift-dns/dns-default-m8drm" Jul 11 01:07:18.214956 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:07:18.214523 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 11 01:07:18.214956 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:07:18.214592 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64-metrics-tls podName:dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64 nodeName:}" failed. No retries permitted until 2026-07-11 01:07:26.214577793 +0000 UTC m=+50.546053318 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64-metrics-tls") pod "dns-default-m8drm" (UID: "dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64") : secret "dns-default-metrics-tls" not found Jul 11 01:07:26.269939 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:26.269906 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64-metrics-tls\") pod \"dns-default-m8drm\" (UID: \"dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64\") " pod="openshift-dns/dns-default-m8drm" Jul 11 01:07:26.270388 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:07:26.270019 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 11 01:07:26.270388 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:07:26.270066 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64-metrics-tls podName:dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64 nodeName:}" failed. No retries permitted until 2026-07-11 01:07:42.270052571 +0000 UTC m=+66.601528093 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64-metrics-tls") pod "dns-default-m8drm" (UID: "dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64") : secret "dns-default-metrics-tls" not found Jul 11 01:07:35.712673 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:35.712643 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f6dd5d945-jjwb6"] Jul 11 01:07:35.715067 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:35.715050 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f6dd5d945-jjwb6" Jul 11 01:07:35.718502 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:35.718479 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 11 01:07:35.718639 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:35.718527 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 11 01:07:35.718639 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:35.718527 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 11 01:07:35.718639 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:35.718556 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 11 01:07:35.724657 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:35.724636 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f6dd5d945-jjwb6"] Jul 11 01:07:35.765048 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:35.765021 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57d6486489-dqqwk"] Jul 11 01:07:35.766874 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:35.766859 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57d6486489-dqqwk" Jul 11 01:07:35.769167 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:35.769141 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 11 01:07:35.769296 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:35.769178 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 11 01:07:35.769296 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:35.769170 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 11 01:07:35.769296 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:35.769285 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 11 01:07:35.777164 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:35.777142 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57d6486489-dqqwk"] Jul 11 01:07:35.838474 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:35.838445 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k65jm\" (UniqueName: \"kubernetes.io/projected/b5a6c9fb-1174-42bc-82d9-505d4385a419-kube-api-access-k65jm\") pod \"klusterlet-addon-workmgr-7f6dd5d945-jjwb6\" (UID: \"b5a6c9fb-1174-42bc-82d9-505d4385a419\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f6dd5d945-jjwb6" Jul 11 01:07:35.838474 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:35.838475 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b5a6c9fb-1174-42bc-82d9-505d4385a419-tmp\") pod \"klusterlet-addon-workmgr-7f6dd5d945-jjwb6\" (UID: \"b5a6c9fb-1174-42bc-82d9-505d4385a419\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f6dd5d945-jjwb6" Jul 11 01:07:35.838676 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:35.838506 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b5a6c9fb-1174-42bc-82d9-505d4385a419-klusterlet-config\") pod \"klusterlet-addon-workmgr-7f6dd5d945-jjwb6\" (UID: \"b5a6c9fb-1174-42bc-82d9-505d4385a419\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f6dd5d945-jjwb6" Jul 11 01:07:35.939206 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:35.939172 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k65jm\" (UniqueName: \"kubernetes.io/projected/b5a6c9fb-1174-42bc-82d9-505d4385a419-kube-api-access-k65jm\") pod \"klusterlet-addon-workmgr-7f6dd5d945-jjwb6\" (UID: \"b5a6c9fb-1174-42bc-82d9-505d4385a419\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f6dd5d945-jjwb6" Jul 11 01:07:35.939341 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:35.939213 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc895238-fc29-44f5-994d-e111ad62f388-additional-service-ca\") pod \"cluster-proxy-proxy-agent-57d6486489-dqqwk\" (UID: \"cc895238-fc29-44f5-994d-e111ad62f388\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57d6486489-dqqwk" Jul 11 01:07:35.939341 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:35.939234 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b5a6c9fb-1174-42bc-82d9-505d4385a419-tmp\") pod \"klusterlet-addon-workmgr-7f6dd5d945-jjwb6\" (UID: \"b5a6c9fb-1174-42bc-82d9-505d4385a419\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f6dd5d945-jjwb6" Jul 11 01:07:35.939341 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:35.939251 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bw248\" (UniqueName: \"kubernetes.io/projected/cc895238-fc29-44f5-994d-e111ad62f388-kube-api-access-bw248\") pod \"cluster-proxy-proxy-agent-57d6486489-dqqwk\" (UID: \"cc895238-fc29-44f5-994d-e111ad62f388\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57d6486489-dqqwk" Jul 11 01:07:35.939341 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:35.939298 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/cc895238-fc29-44f5-994d-e111ad62f388-ca\") pod \"cluster-proxy-proxy-agent-57d6486489-dqqwk\" (UID: \"cc895238-fc29-44f5-994d-e111ad62f388\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57d6486489-dqqwk" Jul 11 01:07:35.939341 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:35.939326 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/cc895238-fc29-44f5-994d-e111ad62f388-hub\") pod \"cluster-proxy-proxy-agent-57d6486489-dqqwk\" (UID: \"cc895238-fc29-44f5-994d-e111ad62f388\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57d6486489-dqqwk" Jul 11 01:07:35.939565 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:35.939342 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/cc895238-fc29-44f5-994d-e111ad62f388-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-57d6486489-dqqwk\" (UID: \"cc895238-fc29-44f5-994d-e111ad62f388\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57d6486489-dqqwk" Jul 11 01:07:35.939565 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:35.939396 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cc895238-fc29-44f5-994d-e111ad62f388-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-57d6486489-dqqwk\" (UID: \"cc895238-fc29-44f5-994d-e111ad62f388\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57d6486489-dqqwk" Jul 11 01:07:35.939565 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:35.939452 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b5a6c9fb-1174-42bc-82d9-505d4385a419-klusterlet-config\") pod \"klusterlet-addon-workmgr-7f6dd5d945-jjwb6\" (UID: \"b5a6c9fb-1174-42bc-82d9-505d4385a419\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f6dd5d945-jjwb6" Jul 11 01:07:35.939683 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:35.939594 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b5a6c9fb-1174-42bc-82d9-505d4385a419-tmp\") pod \"klusterlet-addon-workmgr-7f6dd5d945-jjwb6\" (UID: \"b5a6c9fb-1174-42bc-82d9-505d4385a419\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f6dd5d945-jjwb6" Jul 11 01:07:35.943260 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:35.943244 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b5a6c9fb-1174-42bc-82d9-505d4385a419-klusterlet-config\") pod \"klusterlet-addon-workmgr-7f6dd5d945-jjwb6\" (UID: \"b5a6c9fb-1174-42bc-82d9-505d4385a419\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f6dd5d945-jjwb6" Jul 11 01:07:35.946954 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:35.946936 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k65jm\" (UniqueName: \"kubernetes.io/projected/b5a6c9fb-1174-42bc-82d9-505d4385a419-kube-api-access-k65jm\") pod \"klusterlet-addon-workmgr-7f6dd5d945-jjwb6\" (UID: \"b5a6c9fb-1174-42bc-82d9-505d4385a419\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f6dd5d945-jjwb6" Jul 11 01:07:36.024202 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:36.024132 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f6dd5d945-jjwb6" Jul 11 01:07:36.040128 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:36.040097 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/cc895238-fc29-44f5-994d-e111ad62f388-ca\") pod \"cluster-proxy-proxy-agent-57d6486489-dqqwk\" (UID: \"cc895238-fc29-44f5-994d-e111ad62f388\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57d6486489-dqqwk" Jul 11 01:07:36.040128 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:36.040128 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/cc895238-fc29-44f5-994d-e111ad62f388-hub\") pod \"cluster-proxy-proxy-agent-57d6486489-dqqwk\" (UID: \"cc895238-fc29-44f5-994d-e111ad62f388\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57d6486489-dqqwk" Jul 11 01:07:36.040264 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:36.040145 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/cc895238-fc29-44f5-994d-e111ad62f388-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-57d6486489-dqqwk\" (UID: \"cc895238-fc29-44f5-994d-e111ad62f388\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57d6486489-dqqwk" Jul 11 01:07:36.040264 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:36.040164 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cc895238-fc29-44f5-994d-e111ad62f388-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-57d6486489-dqqwk\" (UID: \"cc895238-fc29-44f5-994d-e111ad62f388\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57d6486489-dqqwk" Jul 11 01:07:36.040501 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:36.040476 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc895238-fc29-44f5-994d-e111ad62f388-additional-service-ca\") pod \"cluster-proxy-proxy-agent-57d6486489-dqqwk\" (UID: \"cc895238-fc29-44f5-994d-e111ad62f388\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57d6486489-dqqwk" Jul 11 01:07:36.040584 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:36.040524 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bw248\" (UniqueName: \"kubernetes.io/projected/cc895238-fc29-44f5-994d-e111ad62f388-kube-api-access-bw248\") pod \"cluster-proxy-proxy-agent-57d6486489-dqqwk\" (UID: \"cc895238-fc29-44f5-994d-e111ad62f388\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57d6486489-dqqwk" Jul 11 01:07:36.041219 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:36.041184 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc895238-fc29-44f5-994d-e111ad62f388-additional-service-ca\") pod \"cluster-proxy-proxy-agent-57d6486489-dqqwk\" (UID: \"cc895238-fc29-44f5-994d-e111ad62f388\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57d6486489-dqqwk" Jul 11 01:07:36.042893 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:36.042780 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cc895238-fc29-44f5-994d-e111ad62f388-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-57d6486489-dqqwk\" (UID: \"cc895238-fc29-44f5-994d-e111ad62f388\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57d6486489-dqqwk" Jul 11 01:07:36.043089 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:36.043063 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/cc895238-fc29-44f5-994d-e111ad62f388-ca\") pod \"cluster-proxy-proxy-agent-57d6486489-dqqwk\" (UID: \"cc895238-fc29-44f5-994d-e111ad62f388\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57d6486489-dqqwk" Jul 11 01:07:36.043173 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:36.043068 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/cc895238-fc29-44f5-994d-e111ad62f388-hub\") pod \"cluster-proxy-proxy-agent-57d6486489-dqqwk\" (UID: \"cc895238-fc29-44f5-994d-e111ad62f388\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57d6486489-dqqwk" Jul 11 01:07:36.043173 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:36.043096 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/cc895238-fc29-44f5-994d-e111ad62f388-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-57d6486489-dqqwk\" (UID: \"cc895238-fc29-44f5-994d-e111ad62f388\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57d6486489-dqqwk" Jul 11 01:07:36.047484 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:36.047465 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bw248\" (UniqueName: \"kubernetes.io/projected/cc895238-fc29-44f5-994d-e111ad62f388-kube-api-access-bw248\") pod \"cluster-proxy-proxy-agent-57d6486489-dqqwk\" (UID: \"cc895238-fc29-44f5-994d-e111ad62f388\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57d6486489-dqqwk" Jul 11 01:07:36.094105 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:36.094057 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57d6486489-dqqwk" Jul 11 01:07:36.149087 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:36.148989 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f6dd5d945-jjwb6"] Jul 11 01:07:36.221124 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:36.221088 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57d6486489-dqqwk"] Jul 11 01:07:36.223670 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:07:36.223643 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcc895238_fc29_44f5_994d_e111ad62f388.slice/crio-a493ee0aeb4888b13fbdc11f46030beb0e52934955d6efe4493b438b290080f5 WatchSource:0}: Error finding container a493ee0aeb4888b13fbdc11f46030beb0e52934955d6efe4493b438b290080f5: Status 404 returned error can't find the container with id a493ee0aeb4888b13fbdc11f46030beb0e52934955d6efe4493b438b290080f5 Jul 11 01:07:36.632987 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:36.632962 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hww5x" Jul 11 01:07:36.714102 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:36.714071 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57d6486489-dqqwk" event={"ID":"cc895238-fc29-44f5-994d-e111ad62f388","Type":"ContainerStarted","Data":"a493ee0aeb4888b13fbdc11f46030beb0e52934955d6efe4493b438b290080f5"} Jul 11 01:07:36.715038 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:36.715014 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f6dd5d945-jjwb6" event={"ID":"b5a6c9fb-1174-42bc-82d9-505d4385a419","Type":"ContainerStarted","Data":"bba83d7ddbcfdba5b5cd13721de2fd5dd22a89fd105c483953f7b5e816ecccfc"} Jul 11 01:07:40.976400 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:40.976362 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfl99\" (UniqueName: \"kubernetes.io/projected/95087320-8e0c-484c-b734-3360faeff948-kube-api-access-nfl99\") pod \"network-check-target-m82rx\" (UID: \"95087320-8e0c-484c-b734-3360faeff948\") " pod="openshift-network-diagnostics/network-check-target-m82rx" Jul 11 01:07:40.976868 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:40.976417 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/99a7e6d5-7736-4a0e-b4c2-12f925deb1b2-original-pull-secret\") pod \"global-pull-secret-syncer-vmt4r\" (UID: \"99a7e6d5-7736-4a0e-b4c2-12f925deb1b2\") " pod="kube-system/global-pull-secret-syncer-vmt4r" Jul 11 01:07:40.976868 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:40.976449 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6de25e6a-b433-4f08-941a-9666d215fe54-metrics-certs\") pod \"network-metrics-daemon-4j8b6\" (UID: \"6de25e6a-b433-4f08-941a-9666d215fe54\") " pod="openshift-multus/network-metrics-daemon-4j8b6" Jul 11 01:07:40.978878 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:40.978846 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 11 01:07:40.978878 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:40.978853 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 11 01:07:40.979045 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:40.978939 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 11 01:07:40.987066 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:07:40.987045 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 11 01:07:40.987180 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:07:40.987165 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6de25e6a-b433-4f08-941a-9666d215fe54-metrics-certs podName:6de25e6a-b433-4f08-941a-9666d215fe54 nodeName:}" failed. No retries permitted until 2026-07-11 01:08:44.987095593 +0000 UTC m=+129.318571136 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6de25e6a-b433-4f08-941a-9666d215fe54-metrics-certs") pod "network-metrics-daemon-4j8b6" (UID: "6de25e6a-b433-4f08-941a-9666d215fe54") : secret "metrics-daemon-secret" not found Jul 11 01:07:40.989159 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:40.989133 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 11 01:07:40.989440 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:40.989420 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/99a7e6d5-7736-4a0e-b4c2-12f925deb1b2-original-pull-secret\") pod \"global-pull-secret-syncer-vmt4r\" (UID: \"99a7e6d5-7736-4a0e-b4c2-12f925deb1b2\") " pod="kube-system/global-pull-secret-syncer-vmt4r" Jul 11 01:07:40.999521 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:40.999499 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfl99\" (UniqueName: \"kubernetes.io/projected/95087320-8e0c-484c-b734-3360faeff948-kube-api-access-nfl99\") pod \"network-check-target-m82rx\" (UID: \"95087320-8e0c-484c-b734-3360faeff948\") " pod="openshift-network-diagnostics/network-check-target-m82rx" Jul 11 01:07:41.267482 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:41.267410 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8v8tm\"" Jul 11 01:07:41.270306 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:41.270286 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmt4r" Jul 11 01:07:41.275421 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:41.275405 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m82rx" Jul 11 01:07:41.658054 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:41.657903 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vmt4r"] Jul 11 01:07:41.661158 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:07:41.661128 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99a7e6d5_7736_4a0e_b4c2_12f925deb1b2.slice/crio-11cad2b2eae0bb3e331e2eb86038318bd4a134188b6830fc12948e5ce7bf5902 WatchSource:0}: Error finding container 11cad2b2eae0bb3e331e2eb86038318bd4a134188b6830fc12948e5ce7bf5902: Status 404 returned error can't find the container with id 11cad2b2eae0bb3e331e2eb86038318bd4a134188b6830fc12948e5ce7bf5902 Jul 11 01:07:41.674253 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:41.674222 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-m82rx"] Jul 11 01:07:41.678162 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:07:41.678138 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95087320_8e0c_484c_b734_3360faeff948.slice/crio-8572f668788c6ca2f9bb0e0d36fcaaa40afff9328b5a1146b4fe98093a194579 WatchSource:0}: Error finding container 8572f668788c6ca2f9bb0e0d36fcaaa40afff9328b5a1146b4fe98093a194579: Status 404 returned error can't find the container with id 8572f668788c6ca2f9bb0e0d36fcaaa40afff9328b5a1146b4fe98093a194579 Jul 11 01:07:41.729671 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:41.729644 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vmt4r" event={"ID":"99a7e6d5-7736-4a0e-b4c2-12f925deb1b2","Type":"ContainerStarted","Data":"11cad2b2eae0bb3e331e2eb86038318bd4a134188b6830fc12948e5ce7bf5902"} Jul 11 01:07:41.731751 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:41.731730 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57d6486489-dqqwk" event={"ID":"cc895238-fc29-44f5-994d-e111ad62f388","Type":"ContainerStarted","Data":"906767465b9fe47797bf713c586aa6702f61e692a82b5421359d1e97c49d100b"} Jul 11 01:07:41.731840 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:41.731762 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57d6486489-dqqwk" event={"ID":"cc895238-fc29-44f5-994d-e111ad62f388","Type":"ContainerStarted","Data":"4a4507e456bef18f8dbcaa3b2cfa0fc9b99a522f108d87dffac9e1b399450b7e"} Jul 11 01:07:41.732808 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:41.732788 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-m82rx" event={"ID":"95087320-8e0c-484c-b734-3360faeff948","Type":"ContainerStarted","Data":"8572f668788c6ca2f9bb0e0d36fcaaa40afff9328b5a1146b4fe98093a194579"} Jul 11 01:07:41.734118 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:41.734101 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f6dd5d945-jjwb6" event={"ID":"b5a6c9fb-1174-42bc-82d9-505d4385a419","Type":"ContainerStarted","Data":"b045f4d32ff04aa8cc024f28cdf317787ef109d0d93f3402b3f4f67743d2ad75"} Jul 11 01:07:41.734275 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:41.734259 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f6dd5d945-jjwb6" Jul 11 01:07:41.735858 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:41.735836 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f6dd5d945-jjwb6" Jul 11 01:07:41.751845 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:41.751803 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f6dd5d945-jjwb6" podStartSLOduration=1.364968719 podStartE2EDuration="6.751789401s" totalImagesPullingTime="5.386820682s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:07:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:07:41.751446727 +0000 UTC m=+66.082922272" watchObservedRunningTime="2026-07-11 01:07:41.751789401 +0000 UTC m=+66.083264944" Jul 11 01:07:42.285885 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:42.285855 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64-metrics-tls\") pod \"dns-default-m8drm\" (UID: \"dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64\") " pod="openshift-dns/dns-default-m8drm" Jul 11 01:07:42.286287 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:07:42.285991 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 11 01:07:42.286287 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:07:42.286050 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64-metrics-tls podName:dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64 nodeName:}" failed. No retries permitted until 2026-07-11 01:08:14.286031212 +0000 UTC m=+98.617506738 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64-metrics-tls") pod "dns-default-m8drm" (UID: "dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64") : secret "dns-default-metrics-tls" not found Jul 11 01:07:42.738141 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:42.738105 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57d6486489-dqqwk" event={"ID":"cc895238-fc29-44f5-994d-e111ad62f388","Type":"ContainerStarted","Data":"4744feb9f3f1f2d834e40841c85fab252305af2652f9462a56aec01121225768"} Jul 11 01:07:42.754934 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:42.754878 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57d6486489-dqqwk" podStartSLOduration=2.4458020019999998 podStartE2EDuration="7.754856616s" totalImagesPullingTime="5.309054614s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:07:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:07:42.754827603 +0000 UTC m=+67.086303148" watchObservedRunningTime="2026-07-11 01:07:42.754856616 +0000 UTC m=+67.086332164" Jul 11 01:07:46.753008 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:46.752976 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-m82rx" event={"ID":"95087320-8e0c-484c-b734-3360faeff948","Type":"ContainerStarted","Data":"fb1464987bf4655d80400d660cf40878db9d8fb6dd9e39ddb5471b2e34e89d29"} Jul 11 01:07:46.753434 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:46.753061 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-m82rx" Jul 11 01:07:46.754430 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:46.754399 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vmt4r" event={"ID":"99a7e6d5-7736-4a0e-b4c2-12f925deb1b2","Type":"ContainerStarted","Data":"2c380ba91c91b21f5161c345e49dc183243fdfd653c76fca248771fe9b52233d"} Jul 11 01:07:46.768128 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:46.768085 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-m82rx" podStartSLOduration=66.174127231 podStartE2EDuration="1m10.768071811s" totalImagesPullingTime="4.59394458s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:06:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:07:46.76766145 +0000 UTC m=+71.099137212" watchObservedRunningTime="2026-07-11 01:07:46.768071811 +0000 UTC m=+71.099547356" Jul 11 01:07:46.781787 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:07:46.781743 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-vmt4r" podStartSLOduration=65.85191745 podStartE2EDuration="1m10.78172944s" totalImagesPullingTime="4.92981199s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 01:06:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:07:46.780791954 +0000 UTC m=+71.112267534" watchObservedRunningTime="2026-07-11 01:07:46.78172944 +0000 UTC m=+71.113204984" Jul 11 01:08:14.297783 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:08:14.297739 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64-metrics-tls\") pod \"dns-default-m8drm\" (UID: \"dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64\") " pod="openshift-dns/dns-default-m8drm" Jul 11 01:08:14.298253 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:08:14.297899 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 11 01:08:14.298253 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:08:14.297979 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64-metrics-tls podName:dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64 nodeName:}" failed. No retries permitted until 2026-07-11 01:09:18.297959432 +0000 UTC m=+162.629434955 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64-metrics-tls") pod "dns-default-m8drm" (UID: "dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64") : secret "dns-default-metrics-tls" not found Jul 11 01:08:17.759150 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:08:17.759116 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-m82rx" Jul 11 01:08:45.014609 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:08:45.014557 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6de25e6a-b433-4f08-941a-9666d215fe54-metrics-certs\") pod \"network-metrics-daemon-4j8b6\" (UID: \"6de25e6a-b433-4f08-941a-9666d215fe54\") " pod="openshift-multus/network-metrics-daemon-4j8b6" Jul 11 01:08:45.015101 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:08:45.014724 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 11 01:08:45.015101 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:08:45.014806 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6de25e6a-b433-4f08-941a-9666d215fe54-metrics-certs podName:6de25e6a-b433-4f08-941a-9666d215fe54 nodeName:}" failed. No retries permitted until 2026-07-11 01:10:47.014788714 +0000 UTC m=+251.346264236 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6de25e6a-b433-4f08-941a-9666d215fe54-metrics-certs") pod "network-metrics-daemon-4j8b6" (UID: "6de25e6a-b433-4f08-941a-9666d215fe54") : secret "metrics-daemon-secret" not found Jul 11 01:09:13.474136 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:09:13.474082 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-m8drm" podUID="dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64" Jul 11 01:09:13.999202 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:09:13.999175 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-m8drm" Jul 11 01:09:14.276127 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:09:14.276049 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-4j8b6" podUID="6de25e6a-b433-4f08-941a-9666d215fe54" Jul 11 01:09:18.351242 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:09:18.351198 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64-metrics-tls\") pod \"dns-default-m8drm\" (UID: \"dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64\") " pod="openshift-dns/dns-default-m8drm" Jul 11 01:09:18.351790 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:09:18.351346 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 11 01:09:18.351790 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:09:18.351419 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64-metrics-tls podName:dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64 nodeName:}" failed. No retries permitted until 2026-07-11 01:11:20.351403852 +0000 UTC m=+284.682879373 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64-metrics-tls") pod "dns-default-m8drm" (UID: "dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64") : secret "dns-default-metrics-tls" not found Jul 11 01:09:29.251923 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:09:29.251827 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4j8b6" Jul 11 01:09:41.734881 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:09:41.734831 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f6dd5d945-jjwb6" podUID="b5a6c9fb-1174-42bc-82d9-505d4385a419" containerName="acm-agent" probeResult="failure" output="Get \"http://10.134.0.8:8000/readyz\": dial tcp 10.134.0.8:8000: connect: connection refused" Jul 11 01:09:42.076381 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:09:42.076349 2572 generic.go:356] "Generic (PLEG): container finished" podID="b5a6c9fb-1174-42bc-82d9-505d4385a419" containerID="b045f4d32ff04aa8cc024f28cdf317787ef109d0d93f3402b3f4f67743d2ad75" exitCode=1 Jul 11 01:09:42.076533 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:09:42.076425 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f6dd5d945-jjwb6" event={"ID":"b5a6c9fb-1174-42bc-82d9-505d4385a419","Type":"ContainerDied","Data":"b045f4d32ff04aa8cc024f28cdf317787ef109d0d93f3402b3f4f67743d2ad75"} Jul 11 01:09:42.076757 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:09:42.076744 2572 scope.go:117] "RemoveContainer" containerID="b045f4d32ff04aa8cc024f28cdf317787ef109d0d93f3402b3f4f67743d2ad75" Jul 11 01:09:43.081817 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:09:43.081786 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f6dd5d945-jjwb6" event={"ID":"b5a6c9fb-1174-42bc-82d9-505d4385a419","Type":"ContainerStarted","Data":"eb92cc5857bb6f72c6d1c03c3a489b51e3c0584ac7de6e8a7c0014cbbae82df0"} Jul 11 01:09:43.082196 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:09:43.082052 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f6dd5d945-jjwb6" Jul 11 01:09:43.082596 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:09:43.082580 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f6dd5d945-jjwb6" Jul 11 01:10:34.588962 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:10:34.588928 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-hh6v6"] Jul 11 01:10:34.591993 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:10:34.591970 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hh6v6" Jul 11 01:10:34.594648 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:10:34.594628 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 11 01:10:34.594756 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:10:34.594647 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 11 01:10:34.595812 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:10:34.595775 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 11 01:10:34.595812 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:10:34.595790 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 11 01:10:34.595812 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:10:34.595806 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-w4nn2\"" Jul 11 01:10:34.600019 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:10:34.599997 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hh6v6"] Jul 11 01:10:34.657037 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:10:34.656991 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6b8b\" (UniqueName: \"kubernetes.io/projected/2de11321-a574-4567-9e84-a4d4dc1ba91a-kube-api-access-x6b8b\") pod \"insights-runtime-extractor-hh6v6\" (UID: \"2de11321-a574-4567-9e84-a4d4dc1ba91a\") " pod="openshift-insights/insights-runtime-extractor-hh6v6" Jul 11 01:10:34.657037 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:10:34.657038 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2de11321-a574-4567-9e84-a4d4dc1ba91a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hh6v6\" (UID: \"2de11321-a574-4567-9e84-a4d4dc1ba91a\") " pod="openshift-insights/insights-runtime-extractor-hh6v6" Jul 11 01:10:34.657244 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:10:34.657147 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2de11321-a574-4567-9e84-a4d4dc1ba91a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hh6v6\" (UID: \"2de11321-a574-4567-9e84-a4d4dc1ba91a\") " pod="openshift-insights/insights-runtime-extractor-hh6v6" Jul 11 01:10:34.657244 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:10:34.657188 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2de11321-a574-4567-9e84-a4d4dc1ba91a-crio-socket\") pod \"insights-runtime-extractor-hh6v6\" (UID: \"2de11321-a574-4567-9e84-a4d4dc1ba91a\") " pod="openshift-insights/insights-runtime-extractor-hh6v6" Jul 11 01:10:34.657244 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:10:34.657209 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2de11321-a574-4567-9e84-a4d4dc1ba91a-data-volume\") pod \"insights-runtime-extractor-hh6v6\" (UID: \"2de11321-a574-4567-9e84-a4d4dc1ba91a\") " pod="openshift-insights/insights-runtime-extractor-hh6v6" Jul 11 01:10:34.758500 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:10:34.758455 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2de11321-a574-4567-9e84-a4d4dc1ba91a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hh6v6\" (UID: \"2de11321-a574-4567-9e84-a4d4dc1ba91a\") " pod="openshift-insights/insights-runtime-extractor-hh6v6" Jul 11 01:10:34.758500 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:10:34.758505 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2de11321-a574-4567-9e84-a4d4dc1ba91a-crio-socket\") pod \"insights-runtime-extractor-hh6v6\" (UID: \"2de11321-a574-4567-9e84-a4d4dc1ba91a\") " pod="openshift-insights/insights-runtime-extractor-hh6v6" Jul 11 01:10:34.758636 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:10:34.758521 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2de11321-a574-4567-9e84-a4d4dc1ba91a-data-volume\") pod \"insights-runtime-extractor-hh6v6\" (UID: \"2de11321-a574-4567-9e84-a4d4dc1ba91a\") " pod="openshift-insights/insights-runtime-extractor-hh6v6" Jul 11 01:10:34.758636 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:10:34.758541 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6b8b\" (UniqueName: \"kubernetes.io/projected/2de11321-a574-4567-9e84-a4d4dc1ba91a-kube-api-access-x6b8b\") pod \"insights-runtime-extractor-hh6v6\" (UID: \"2de11321-a574-4567-9e84-a4d4dc1ba91a\") " pod="openshift-insights/insights-runtime-extractor-hh6v6" Jul 11 01:10:34.758636 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:10:34.758571 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2de11321-a574-4567-9e84-a4d4dc1ba91a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hh6v6\" (UID: \"2de11321-a574-4567-9e84-a4d4dc1ba91a\") " pod="openshift-insights/insights-runtime-extractor-hh6v6" Jul 11 01:10:34.758636 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:10:34.758572 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 11 01:10:34.758636 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:10:34.758589 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2de11321-a574-4567-9e84-a4d4dc1ba91a-crio-socket\") pod \"insights-runtime-extractor-hh6v6\" (UID: \"2de11321-a574-4567-9e84-a4d4dc1ba91a\") " pod="openshift-insights/insights-runtime-extractor-hh6v6" Jul 11 01:10:34.758819 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:10:34.758643 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2de11321-a574-4567-9e84-a4d4dc1ba91a-kube-rbac-proxy-cm podName:2de11321-a574-4567-9e84-a4d4dc1ba91a nodeName:}" failed. No retries permitted until 2026-07-11 01:10:35.258627479 +0000 UTC m=+239.590103013 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2de11321-a574-4567-9e84-a4d4dc1ba91a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hh6v6" (UID: "2de11321-a574-4567-9e84-a4d4dc1ba91a") : configmap "kube-rbac-proxy" not found Jul 11 01:10:34.758819 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:10:34.758658 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 11 01:10:34.758819 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:10:34.758750 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2de11321-a574-4567-9e84-a4d4dc1ba91a-insights-runtime-extractor-tls podName:2de11321-a574-4567-9e84-a4d4dc1ba91a nodeName:}" failed. No retries permitted until 2026-07-11 01:10:35.258735118 +0000 UTC m=+239.590210640 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2de11321-a574-4567-9e84-a4d4dc1ba91a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hh6v6" (UID: "2de11321-a574-4567-9e84-a4d4dc1ba91a") : secret "insights-runtime-extractor-tls" not found Jul 11 01:10:34.758924 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:10:34.758856 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2de11321-a574-4567-9e84-a4d4dc1ba91a-data-volume\") pod \"insights-runtime-extractor-hh6v6\" (UID: \"2de11321-a574-4567-9e84-a4d4dc1ba91a\") " pod="openshift-insights/insights-runtime-extractor-hh6v6" Jul 11 01:10:34.765681 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:10:34.765660 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6b8b\" (UniqueName: \"kubernetes.io/projected/2de11321-a574-4567-9e84-a4d4dc1ba91a-kube-api-access-x6b8b\") pod \"insights-runtime-extractor-hh6v6\" (UID: \"2de11321-a574-4567-9e84-a4d4dc1ba91a\") " pod="openshift-insights/insights-runtime-extractor-hh6v6" Jul 11 01:10:35.262881 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:10:35.262849 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2de11321-a574-4567-9e84-a4d4dc1ba91a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hh6v6\" (UID: \"2de11321-a574-4567-9e84-a4d4dc1ba91a\") " pod="openshift-insights/insights-runtime-extractor-hh6v6" Jul 11 01:10:35.263048 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:10:35.262895 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2de11321-a574-4567-9e84-a4d4dc1ba91a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hh6v6\" (UID: \"2de11321-a574-4567-9e84-a4d4dc1ba91a\") " pod="openshift-insights/insights-runtime-extractor-hh6v6" Jul 11 01:10:35.263048 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:10:35.262969 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 11 01:10:35.263048 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:10:35.262992 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 11 01:10:35.263048 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:10:35.263037 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2de11321-a574-4567-9e84-a4d4dc1ba91a-insights-runtime-extractor-tls podName:2de11321-a574-4567-9e84-a4d4dc1ba91a nodeName:}" failed. No retries permitted until 2026-07-11 01:10:36.263024078 +0000 UTC m=+240.594499600 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2de11321-a574-4567-9e84-a4d4dc1ba91a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hh6v6" (UID: "2de11321-a574-4567-9e84-a4d4dc1ba91a") : secret "insights-runtime-extractor-tls" not found Jul 11 01:10:35.263048 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:10:35.263049 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2de11321-a574-4567-9e84-a4d4dc1ba91a-kube-rbac-proxy-cm podName:2de11321-a574-4567-9e84-a4d4dc1ba91a nodeName:}" failed. No retries permitted until 2026-07-11 01:10:36.263043425 +0000 UTC m=+240.594518946 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2de11321-a574-4567-9e84-a4d4dc1ba91a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hh6v6" (UID: "2de11321-a574-4567-9e84-a4d4dc1ba91a") : configmap "kube-rbac-proxy" not found Jul 11 01:10:36.270179 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:10:36.270146 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2de11321-a574-4567-9e84-a4d4dc1ba91a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hh6v6\" (UID: \"2de11321-a574-4567-9e84-a4d4dc1ba91a\") " pod="openshift-insights/insights-runtime-extractor-hh6v6" Jul 11 01:10:36.270644 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:10:36.270214 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2de11321-a574-4567-9e84-a4d4dc1ba91a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hh6v6\" (UID: \"2de11321-a574-4567-9e84-a4d4dc1ba91a\") " pod="openshift-insights/insights-runtime-extractor-hh6v6" Jul 11 01:10:36.270644 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:10:36.270283 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 11 01:10:36.270644 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:10:36.270319 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 11 01:10:36.270644 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:10:36.270332 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2de11321-a574-4567-9e84-a4d4dc1ba91a-kube-rbac-proxy-cm podName:2de11321-a574-4567-9e84-a4d4dc1ba91a nodeName:}" failed. No retries permitted until 2026-07-11 01:10:38.270318098 +0000 UTC m=+242.601793619 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2de11321-a574-4567-9e84-a4d4dc1ba91a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hh6v6" (UID: "2de11321-a574-4567-9e84-a4d4dc1ba91a") : configmap "kube-rbac-proxy" not found Jul 11 01:10:36.270644 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:10:36.270394 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2de11321-a574-4567-9e84-a4d4dc1ba91a-insights-runtime-extractor-tls podName:2de11321-a574-4567-9e84-a4d4dc1ba91a nodeName:}" failed. No retries permitted until 2026-07-11 01:10:38.270376667 +0000 UTC m=+242.601852195 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2de11321-a574-4567-9e84-a4d4dc1ba91a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hh6v6" (UID: "2de11321-a574-4567-9e84-a4d4dc1ba91a") : secret "insights-runtime-extractor-tls" not found Jul 11 01:10:36.560954 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:10:36.560873 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jjd8d_e1e3c11c-1b4f-4101-8df4-2e9f1d13a67c/dns-node-resolver/0.log" Jul 11 01:10:37.561053 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:10:37.561022 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-46bl6_ec166c39-ac6d-4182-a8d6-fb0a34eb1915/node-ca/0.log" Jul 11 01:10:38.161043 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:10:38.161015 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jvzch_a252a55d-e8b2-48a9-806e-8f1bae252f2a/serve-healthcheck-canary/0.log" Jul 11 01:10:38.286189 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:10:38.286148 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2de11321-a574-4567-9e84-a4d4dc1ba91a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hh6v6\" (UID: \"2de11321-a574-4567-9e84-a4d4dc1ba91a\") " pod="openshift-insights/insights-runtime-extractor-hh6v6" Jul 11 01:10:38.286363 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:10:38.286223 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2de11321-a574-4567-9e84-a4d4dc1ba91a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hh6v6\" (UID: \"2de11321-a574-4567-9e84-a4d4dc1ba91a\") " pod="openshift-insights/insights-runtime-extractor-hh6v6" Jul 11 01:10:38.286363 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:10:38.286293 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 11 01:10:38.286363 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:10:38.286300 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 11 01:10:38.286363 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:10:38.286347 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2de11321-a574-4567-9e84-a4d4dc1ba91a-kube-rbac-proxy-cm podName:2de11321-a574-4567-9e84-a4d4dc1ba91a nodeName:}" failed. No retries permitted until 2026-07-11 01:10:42.286334074 +0000 UTC m=+246.617809609 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2de11321-a574-4567-9e84-a4d4dc1ba91a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hh6v6" (UID: "2de11321-a574-4567-9e84-a4d4dc1ba91a") : configmap "kube-rbac-proxy" not found Jul 11 01:10:38.286363 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:10:38.286359 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2de11321-a574-4567-9e84-a4d4dc1ba91a-insights-runtime-extractor-tls podName:2de11321-a574-4567-9e84-a4d4dc1ba91a nodeName:}" failed. No retries permitted until 2026-07-11 01:10:42.286353986 +0000 UTC m=+246.617829507 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2de11321-a574-4567-9e84-a4d4dc1ba91a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hh6v6" (UID: "2de11321-a574-4567-9e84-a4d4dc1ba91a") : secret "insights-runtime-extractor-tls" not found Jul 11 01:10:42.319550 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:10:42.319511 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2de11321-a574-4567-9e84-a4d4dc1ba91a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hh6v6\" (UID: \"2de11321-a574-4567-9e84-a4d4dc1ba91a\") " pod="openshift-insights/insights-runtime-extractor-hh6v6" Jul 11 01:10:42.320031 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:10:42.319614 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 11 01:10:42.320031 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:10:42.319629 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2de11321-a574-4567-9e84-a4d4dc1ba91a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hh6v6\" (UID: \"2de11321-a574-4567-9e84-a4d4dc1ba91a\") " pod="openshift-insights/insights-runtime-extractor-hh6v6" Jul 11 01:10:42.320031 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:10:42.319684 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2de11321-a574-4567-9e84-a4d4dc1ba91a-kube-rbac-proxy-cm podName:2de11321-a574-4567-9e84-a4d4dc1ba91a nodeName:}" failed. No retries permitted until 2026-07-11 01:10:50.319667376 +0000 UTC m=+254.651142901 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2de11321-a574-4567-9e84-a4d4dc1ba91a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hh6v6" (UID: "2de11321-a574-4567-9e84-a4d4dc1ba91a") : configmap "kube-rbac-proxy" not found Jul 11 01:10:42.320031 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:10:42.319771 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 11 01:10:42.320031 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:10:42.319853 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2de11321-a574-4567-9e84-a4d4dc1ba91a-insights-runtime-extractor-tls podName:2de11321-a574-4567-9e84-a4d4dc1ba91a nodeName:}" failed. No retries permitted until 2026-07-11 01:10:50.319835249 +0000 UTC m=+254.651310792 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2de11321-a574-4567-9e84-a4d4dc1ba91a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hh6v6" (UID: "2de11321-a574-4567-9e84-a4d4dc1ba91a") : secret "insights-runtime-extractor-tls" not found Jul 11 01:10:46.095382 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:10:46.095347 2572 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57d6486489-dqqwk" podUID="cc895238-fc29-44f5-994d-e111ad62f388" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 11 01:10:47.054489 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:10:47.054453 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6de25e6a-b433-4f08-941a-9666d215fe54-metrics-certs\") pod \"network-metrics-daemon-4j8b6\" (UID: \"6de25e6a-b433-4f08-941a-9666d215fe54\") " pod="openshift-multus/network-metrics-daemon-4j8b6" Jul 11 01:10:47.054663 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:10:47.054603 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 11 01:10:47.054727 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:10:47.054664 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6de25e6a-b433-4f08-941a-9666d215fe54-metrics-certs podName:6de25e6a-b433-4f08-941a-9666d215fe54 nodeName:}" failed. No retries permitted until 2026-07-11 01:12:49.054648674 +0000 UTC m=+373.386124195 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6de25e6a-b433-4f08-941a-9666d215fe54-metrics-certs") pod "network-metrics-daemon-4j8b6" (UID: "6de25e6a-b433-4f08-941a-9666d215fe54") : secret "metrics-daemon-secret" not found Jul 11 01:10:50.380540 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:10:50.380498 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2de11321-a574-4567-9e84-a4d4dc1ba91a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hh6v6\" (UID: \"2de11321-a574-4567-9e84-a4d4dc1ba91a\") " pod="openshift-insights/insights-runtime-extractor-hh6v6" Jul 11 01:10:50.381024 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:10:50.380652 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 11 01:10:50.381024 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:10:50.380765 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2de11321-a574-4567-9e84-a4d4dc1ba91a-insights-runtime-extractor-tls podName:2de11321-a574-4567-9e84-a4d4dc1ba91a nodeName:}" failed. No retries permitted until 2026-07-11 01:11:06.380743888 +0000 UTC m=+270.712219431 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2de11321-a574-4567-9e84-a4d4dc1ba91a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hh6v6" (UID: "2de11321-a574-4567-9e84-a4d4dc1ba91a") : secret "insights-runtime-extractor-tls" not found Jul 11 01:10:50.381024 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:10:50.380814 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2de11321-a574-4567-9e84-a4d4dc1ba91a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hh6v6\" (UID: \"2de11321-a574-4567-9e84-a4d4dc1ba91a\") " pod="openshift-insights/insights-runtime-extractor-hh6v6" Jul 11 01:10:50.381344 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:10:50.381322 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2de11321-a574-4567-9e84-a4d4dc1ba91a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hh6v6\" (UID: \"2de11321-a574-4567-9e84-a4d4dc1ba91a\") " pod="openshift-insights/insights-runtime-extractor-hh6v6" Jul 11 01:10:56.095177 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:10:56.095139 2572 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57d6486489-dqqwk" podUID="cc895238-fc29-44f5-994d-e111ad62f388" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 11 01:10:58.991175 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:10:58.991146 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-57bf475f95-qf72c"] Jul 11 01:10:58.993875 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:10:58.993859 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57bf475f95-qf72c" Jul 11 01:10:58.996345 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:10:58.996321 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 11 01:10:58.996345 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:10:58.996337 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 11 01:10:58.996548 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:10:58.996373 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-fljvr\"" Jul 11 01:10:58.996548 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:10:58.996391 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 11 01:10:59.001755 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:10:59.001718 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 11 01:10:59.008680 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:10:59.008655 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-57bf475f95-qf72c"] Jul 11 01:10:59.145722 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:10:59.145664 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f684db75-782a-4586-99bc-40de74226d3b-image-registry-private-configuration\") pod \"image-registry-57bf475f95-qf72c\" (UID: \"f684db75-782a-4586-99bc-40de74226d3b\") " pod="openshift-image-registry/image-registry-57bf475f95-qf72c" Jul 11 01:10:59.145722 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:10:59.145721 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f684db75-782a-4586-99bc-40de74226d3b-installation-pull-secrets\") pod \"image-registry-57bf475f95-qf72c\" (UID: \"f684db75-782a-4586-99bc-40de74226d3b\") " pod="openshift-image-registry/image-registry-57bf475f95-qf72c" Jul 11 01:10:59.146011 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:10:59.145791 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f684db75-782a-4586-99bc-40de74226d3b-registry-tls\") pod \"image-registry-57bf475f95-qf72c\" (UID: \"f684db75-782a-4586-99bc-40de74226d3b\") " pod="openshift-image-registry/image-registry-57bf475f95-qf72c" Jul 11 01:10:59.146011 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:10:59.145828 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rg8kr\" (UniqueName: \"kubernetes.io/projected/f684db75-782a-4586-99bc-40de74226d3b-kube-api-access-rg8kr\") pod \"image-registry-57bf475f95-qf72c\" (UID: \"f684db75-782a-4586-99bc-40de74226d3b\") " pod="openshift-image-registry/image-registry-57bf475f95-qf72c" Jul 11 01:10:59.146011 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:10:59.145853 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f684db75-782a-4586-99bc-40de74226d3b-bound-sa-token\") pod \"image-registry-57bf475f95-qf72c\" (UID: \"f684db75-782a-4586-99bc-40de74226d3b\") " pod="openshift-image-registry/image-registry-57bf475f95-qf72c" Jul 11 01:10:59.146011 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:10:59.145873 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f684db75-782a-4586-99bc-40de74226d3b-trusted-ca\") pod \"image-registry-57bf475f95-qf72c\" (UID: \"f684db75-782a-4586-99bc-40de74226d3b\") " pod="openshift-image-registry/image-registry-57bf475f95-qf72c" Jul 11 01:10:59.146011 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:10:59.145900 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f684db75-782a-4586-99bc-40de74226d3b-ca-trust-extracted\") pod \"image-registry-57bf475f95-qf72c\" (UID: \"f684db75-782a-4586-99bc-40de74226d3b\") " pod="openshift-image-registry/image-registry-57bf475f95-qf72c" Jul 11 01:10:59.146011 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:10:59.145915 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f684db75-782a-4586-99bc-40de74226d3b-registry-certificates\") pod \"image-registry-57bf475f95-qf72c\" (UID: \"f684db75-782a-4586-99bc-40de74226d3b\") " pod="openshift-image-registry/image-registry-57bf475f95-qf72c" Jul 11 01:10:59.246262 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:10:59.246179 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f684db75-782a-4586-99bc-40de74226d3b-registry-tls\") pod \"image-registry-57bf475f95-qf72c\" (UID: \"f684db75-782a-4586-99bc-40de74226d3b\") " pod="openshift-image-registry/image-registry-57bf475f95-qf72c" Jul 11 01:10:59.246262 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:10:59.246228 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rg8kr\" (UniqueName: \"kubernetes.io/projected/f684db75-782a-4586-99bc-40de74226d3b-kube-api-access-rg8kr\") pod \"image-registry-57bf475f95-qf72c\" (UID: \"f684db75-782a-4586-99bc-40de74226d3b\") " pod="openshift-image-registry/image-registry-57bf475f95-qf72c" Jul 11 01:10:59.246459 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:10:59.246272 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f684db75-782a-4586-99bc-40de74226d3b-bound-sa-token\") pod \"image-registry-57bf475f95-qf72c\" (UID: \"f684db75-782a-4586-99bc-40de74226d3b\") " pod="openshift-image-registry/image-registry-57bf475f95-qf72c" Jul 11 01:10:59.246459 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:10:59.246303 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f684db75-782a-4586-99bc-40de74226d3b-trusted-ca\") pod \"image-registry-57bf475f95-qf72c\" (UID: \"f684db75-782a-4586-99bc-40de74226d3b\") " pod="openshift-image-registry/image-registry-57bf475f95-qf72c" Jul 11 01:10:59.246557 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:10:59.246458 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f684db75-782a-4586-99bc-40de74226d3b-ca-trust-extracted\") pod \"image-registry-57bf475f95-qf72c\" (UID: \"f684db75-782a-4586-99bc-40de74226d3b\") " pod="openshift-image-registry/image-registry-57bf475f95-qf72c" Jul 11 01:10:59.246557 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:10:59.246508 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f684db75-782a-4586-99bc-40de74226d3b-registry-certificates\") pod \"image-registry-57bf475f95-qf72c\" (UID: \"f684db75-782a-4586-99bc-40de74226d3b\") " pod="openshift-image-registry/image-registry-57bf475f95-qf72c" Jul 11 01:10:59.246557 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:10:59.246537 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f684db75-782a-4586-99bc-40de74226d3b-image-registry-private-configuration\") pod \"image-registry-57bf475f95-qf72c\" (UID: \"f684db75-782a-4586-99bc-40de74226d3b\") " pod="openshift-image-registry/image-registry-57bf475f95-qf72c" Jul 11 01:10:59.246691 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:10:59.246650 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f684db75-782a-4586-99bc-40de74226d3b-installation-pull-secrets\") pod \"image-registry-57bf475f95-qf72c\" (UID: \"f684db75-782a-4586-99bc-40de74226d3b\") " pod="openshift-image-registry/image-registry-57bf475f95-qf72c" Jul 11 01:10:59.246979 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:10:59.246950 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f684db75-782a-4586-99bc-40de74226d3b-ca-trust-extracted\") pod \"image-registry-57bf475f95-qf72c\" (UID: \"f684db75-782a-4586-99bc-40de74226d3b\") " pod="openshift-image-registry/image-registry-57bf475f95-qf72c" Jul 11 01:10:59.247319 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:10:59.247297 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f684db75-782a-4586-99bc-40de74226d3b-registry-certificates\") pod \"image-registry-57bf475f95-qf72c\" (UID: \"f684db75-782a-4586-99bc-40de74226d3b\") " pod="openshift-image-registry/image-registry-57bf475f95-qf72c" Jul 11 01:10:59.247436 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:10:59.247368 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f684db75-782a-4586-99bc-40de74226d3b-trusted-ca\") pod \"image-registry-57bf475f95-qf72c\" (UID: \"f684db75-782a-4586-99bc-40de74226d3b\") " pod="openshift-image-registry/image-registry-57bf475f95-qf72c" Jul 11 01:10:59.248861 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:10:59.248831 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f684db75-782a-4586-99bc-40de74226d3b-registry-tls\") pod \"image-registry-57bf475f95-qf72c\" (UID: \"f684db75-782a-4586-99bc-40de74226d3b\") " pod="openshift-image-registry/image-registry-57bf475f95-qf72c" Jul 11 01:10:59.249241 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:10:59.249220 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f684db75-782a-4586-99bc-40de74226d3b-installation-pull-secrets\") pod \"image-registry-57bf475f95-qf72c\" (UID: \"f684db75-782a-4586-99bc-40de74226d3b\") " pod="openshift-image-registry/image-registry-57bf475f95-qf72c" Jul 11 01:10:59.249336 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:10:59.249304 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f684db75-782a-4586-99bc-40de74226d3b-image-registry-private-configuration\") pod \"image-registry-57bf475f95-qf72c\" (UID: \"f684db75-782a-4586-99bc-40de74226d3b\") " pod="openshift-image-registry/image-registry-57bf475f95-qf72c" Jul 11 01:10:59.253520 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:10:59.253498 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f684db75-782a-4586-99bc-40de74226d3b-bound-sa-token\") pod \"image-registry-57bf475f95-qf72c\" (UID: \"f684db75-782a-4586-99bc-40de74226d3b\") " pod="openshift-image-registry/image-registry-57bf475f95-qf72c" Jul 11 01:10:59.253899 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:10:59.253879 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rg8kr\" (UniqueName: \"kubernetes.io/projected/f684db75-782a-4586-99bc-40de74226d3b-kube-api-access-rg8kr\") pod \"image-registry-57bf475f95-qf72c\" (UID: \"f684db75-782a-4586-99bc-40de74226d3b\") " pod="openshift-image-registry/image-registry-57bf475f95-qf72c" Jul 11 01:10:59.306923 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:10:59.306876 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57bf475f95-qf72c" Jul 11 01:10:59.427506 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:10:59.427474 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-57bf475f95-qf72c"] Jul 11 01:10:59.430820 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:10:59.430796 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf684db75_782a_4586_99bc_40de74226d3b.slice/crio-c218a7c8e2e7b4a1517256336f59955366637355bfd7debf92fb6d24afe9a292 WatchSource:0}: Error finding container c218a7c8e2e7b4a1517256336f59955366637355bfd7debf92fb6d24afe9a292: Status 404 returned error can't find the container with id c218a7c8e2e7b4a1517256336f59955366637355bfd7debf92fb6d24afe9a292 Jul 11 01:11:00.287106 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:00.287068 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57bf475f95-qf72c" event={"ID":"f684db75-782a-4586-99bc-40de74226d3b","Type":"ContainerStarted","Data":"75d80dcc10b287a6c7d416182b417c2d005e0c85ef5baadae162ab9b13ea116c"} Jul 11 01:11:00.287490 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:00.287121 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57bf475f95-qf72c" event={"ID":"f684db75-782a-4586-99bc-40de74226d3b","Type":"ContainerStarted","Data":"c218a7c8e2e7b4a1517256336f59955366637355bfd7debf92fb6d24afe9a292"} Jul 11 01:11:00.287490 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:00.287151 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-57bf475f95-qf72c" Jul 11 01:11:00.307088 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:00.307034 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-57bf475f95-qf72c" podStartSLOduration=2.307016473 podStartE2EDuration="2.307016473s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:10:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:11:00.306866221 +0000 UTC m=+264.638341788" watchObservedRunningTime="2026-07-11 01:11:00.307016473 +0000 UTC m=+264.638492018" Jul 11 01:11:06.095848 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:06.095804 2572 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57d6486489-dqqwk" podUID="cc895238-fc29-44f5-994d-e111ad62f388" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 11 01:11:06.096296 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:06.095888 2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57d6486489-dqqwk" Jul 11 01:11:06.096339 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:06.096309 2572 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"4744feb9f3f1f2d834e40841c85fab252305af2652f9462a56aec01121225768"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57d6486489-dqqwk" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jul 11 01:11:06.096373 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:06.096353 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57d6486489-dqqwk" podUID="cc895238-fc29-44f5-994d-e111ad62f388" containerName="service-proxy" containerID="cri-o://4744feb9f3f1f2d834e40841c85fab252305af2652f9462a56aec01121225768" gracePeriod=30 Jul 11 01:11:06.306690 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:06.306659 2572 generic.go:356] "Generic (PLEG): container finished" podID="cc895238-fc29-44f5-994d-e111ad62f388" containerID="4744feb9f3f1f2d834e40841c85fab252305af2652f9462a56aec01121225768" exitCode=2 Jul 11 01:11:06.306856 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:06.306739 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57d6486489-dqqwk" event={"ID":"cc895238-fc29-44f5-994d-e111ad62f388","Type":"ContainerDied","Data":"4744feb9f3f1f2d834e40841c85fab252305af2652f9462a56aec01121225768"} Jul 11 01:11:06.306856 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:06.306779 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57d6486489-dqqwk" event={"ID":"cc895238-fc29-44f5-994d-e111ad62f388","Type":"ContainerStarted","Data":"621ccd5a95e2fc6141c2b514b80394ab307f2b259692c6b098460d7eafd4ac54"} Jul 11 01:11:06.402167 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:06.402070 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2de11321-a574-4567-9e84-a4d4dc1ba91a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hh6v6\" (UID: \"2de11321-a574-4567-9e84-a4d4dc1ba91a\") " pod="openshift-insights/insights-runtime-extractor-hh6v6" Jul 11 01:11:06.404393 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:06.404371 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2de11321-a574-4567-9e84-a4d4dc1ba91a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hh6v6\" (UID: \"2de11321-a574-4567-9e84-a4d4dc1ba91a\") " pod="openshift-insights/insights-runtime-extractor-hh6v6" Jul 11 01:11:06.702750 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:06.702723 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-w4nn2\"" Jul 11 01:11:06.711354 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:06.711331 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hh6v6" Jul 11 01:11:06.832019 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:06.831986 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hh6v6"] Jul 11 01:11:06.834491 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:11:06.834468 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2de11321_a574_4567_9e84_a4d4dc1ba91a.slice/crio-1e448c8dfd199cd75b0c2f0bac1c3e0cbda823f49c5672edc430eddbeccda228 WatchSource:0}: Error finding container 1e448c8dfd199cd75b0c2f0bac1c3e0cbda823f49c5672edc430eddbeccda228: Status 404 returned error can't find the container with id 1e448c8dfd199cd75b0c2f0bac1c3e0cbda823f49c5672edc430eddbeccda228 Jul 11 01:11:07.311905 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:07.311845 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hh6v6" event={"ID":"2de11321-a574-4567-9e84-a4d4dc1ba91a","Type":"ContainerStarted","Data":"1e448c8dfd199cd75b0c2f0bac1c3e0cbda823f49c5672edc430eddbeccda228"} Jul 11 01:11:11.324677 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:11.324648 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hh6v6" event={"ID":"2de11321-a574-4567-9e84-a4d4dc1ba91a","Type":"ContainerStarted","Data":"b7854f3bed8e428f9ee17abda3b4f25846f893fcc597c6d80dee86eb965c6044"} Jul 11 01:11:11.325013 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:11.324719 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hh6v6" event={"ID":"2de11321-a574-4567-9e84-a4d4dc1ba91a","Type":"ContainerStarted","Data":"c74fa0c065a80aa820518f658002658ecd9866a07da7de5446397f6919373bc4"} Jul 11 01:11:14.337079 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:14.337043 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hh6v6" event={"ID":"2de11321-a574-4567-9e84-a4d4dc1ba91a","Type":"ContainerStarted","Data":"8d6e29745ff58c1a1d969f7173982c0a024a73cf4682b2ce5b6f42c48f190931"} Jul 11 01:11:14.353009 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:14.352954 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-hh6v6" podStartSLOduration=33.587366431 podStartE2EDuration="40.35293786s" totalImagesPullingTime="6.765571429s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 01:10:34 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:11:14.351949232 +0000 UTC m=+278.683424785" watchObservedRunningTime="2026-07-11 01:11:14.35293786 +0000 UTC m=+278.684413406" Jul 11 01:11:15.665669 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:15.665634 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5x9rv"] Jul 11 01:11:15.669093 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:15.669062 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5x9rv" Jul 11 01:11:15.671879 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:15.671859 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 11 01:11:15.672040 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:15.672023 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 11 01:11:15.672091 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:15.672069 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 11 01:11:15.672175 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:15.672148 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 11 01:11:15.672290 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:15.672175 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 11 01:11:15.672290 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:15.672177 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-spdn4\"" Jul 11 01:11:15.672721 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:15.672693 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 11 01:11:15.774438 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:15.774396 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4f564953-49e2-4981-93bf-f185049701e2-root\") pod \"node-exporter-5x9rv\" (UID: \"4f564953-49e2-4981-93bf-f185049701e2\") " pod="openshift-monitoring/node-exporter-5x9rv" Jul 11 01:11:15.774438 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:15.774439 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4f564953-49e2-4981-93bf-f185049701e2-node-exporter-tls\") pod \"node-exporter-5x9rv\" (UID: \"4f564953-49e2-4981-93bf-f185049701e2\") " pod="openshift-monitoring/node-exporter-5x9rv" Jul 11 01:11:15.774642 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:15.774460 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f564953-49e2-4981-93bf-f185049701e2-metrics-client-ca\") pod \"node-exporter-5x9rv\" (UID: \"4f564953-49e2-4981-93bf-f185049701e2\") " pod="openshift-monitoring/node-exporter-5x9rv" Jul 11 01:11:15.774642 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:15.774480 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4f564953-49e2-4981-93bf-f185049701e2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5x9rv\" (UID: \"4f564953-49e2-4981-93bf-f185049701e2\") " pod="openshift-monitoring/node-exporter-5x9rv" Jul 11 01:11:15.774642 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:15.774513 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4f564953-49e2-4981-93bf-f185049701e2-sys\") pod \"node-exporter-5x9rv\" (UID: \"4f564953-49e2-4981-93bf-f185049701e2\") " pod="openshift-monitoring/node-exporter-5x9rv" Jul 11 01:11:15.774642 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:15.774533 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4f564953-49e2-4981-93bf-f185049701e2-node-exporter-accelerators-collector-config\") pod \"node-exporter-5x9rv\" (UID: \"4f564953-49e2-4981-93bf-f185049701e2\") " pod="openshift-monitoring/node-exporter-5x9rv" Jul 11 01:11:15.774642 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:15.774558 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4f564953-49e2-4981-93bf-f185049701e2-node-exporter-wtmp\") pod \"node-exporter-5x9rv\" (UID: \"4f564953-49e2-4981-93bf-f185049701e2\") " pod="openshift-monitoring/node-exporter-5x9rv" Jul 11 01:11:15.774642 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:15.774581 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4f564953-49e2-4981-93bf-f185049701e2-node-exporter-textfile\") pod \"node-exporter-5x9rv\" (UID: \"4f564953-49e2-4981-93bf-f185049701e2\") " pod="openshift-monitoring/node-exporter-5x9rv" Jul 11 01:11:15.774642 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:15.774614 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r87jg\" (UniqueName: \"kubernetes.io/projected/4f564953-49e2-4981-93bf-f185049701e2-kube-api-access-r87jg\") pod \"node-exporter-5x9rv\" (UID: \"4f564953-49e2-4981-93bf-f185049701e2\") " pod="openshift-monitoring/node-exporter-5x9rv" Jul 11 01:11:15.875546 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:15.875495 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4f564953-49e2-4981-93bf-f185049701e2-root\") pod \"node-exporter-5x9rv\" (UID: \"4f564953-49e2-4981-93bf-f185049701e2\") " pod="openshift-monitoring/node-exporter-5x9rv" Jul 11 01:11:15.875725 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:15.875551 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4f564953-49e2-4981-93bf-f185049701e2-node-exporter-tls\") pod \"node-exporter-5x9rv\" (UID: \"4f564953-49e2-4981-93bf-f185049701e2\") " pod="openshift-monitoring/node-exporter-5x9rv" Jul 11 01:11:15.875725 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:15.875579 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f564953-49e2-4981-93bf-f185049701e2-metrics-client-ca\") pod \"node-exporter-5x9rv\" (UID: \"4f564953-49e2-4981-93bf-f185049701e2\") " pod="openshift-monitoring/node-exporter-5x9rv" Jul 11 01:11:15.875725 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:15.875607 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4f564953-49e2-4981-93bf-f185049701e2-root\") pod \"node-exporter-5x9rv\" (UID: \"4f564953-49e2-4981-93bf-f185049701e2\") " pod="openshift-monitoring/node-exporter-5x9rv" Jul 11 01:11:15.875725 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:15.875610 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4f564953-49e2-4981-93bf-f185049701e2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5x9rv\" (UID: \"4f564953-49e2-4981-93bf-f185049701e2\") " pod="openshift-monitoring/node-exporter-5x9rv" Jul 11 01:11:15.875725 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:15.875667 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4f564953-49e2-4981-93bf-f185049701e2-sys\") pod \"node-exporter-5x9rv\" (UID: \"4f564953-49e2-4981-93bf-f185049701e2\") " pod="openshift-monitoring/node-exporter-5x9rv" Jul 11 01:11:15.875725 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:15.875721 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4f564953-49e2-4981-93bf-f185049701e2-node-exporter-accelerators-collector-config\") pod \"node-exporter-5x9rv\" (UID: \"4f564953-49e2-4981-93bf-f185049701e2\") " pod="openshift-monitoring/node-exporter-5x9rv" Jul 11 01:11:15.876027 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:15.875768 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4f564953-49e2-4981-93bf-f185049701e2-node-exporter-wtmp\") pod \"node-exporter-5x9rv\" (UID: \"4f564953-49e2-4981-93bf-f185049701e2\") " pod="openshift-monitoring/node-exporter-5x9rv" Jul 11 01:11:15.876027 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:11:15.875782 2572 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 11 01:11:15.876027 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:15.875806 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4f564953-49e2-4981-93bf-f185049701e2-node-exporter-textfile\") pod \"node-exporter-5x9rv\" (UID: \"4f564953-49e2-4981-93bf-f185049701e2\") " pod="openshift-monitoring/node-exporter-5x9rv" Jul 11 01:11:15.876027 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:11:15.875873 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f564953-49e2-4981-93bf-f185049701e2-node-exporter-tls podName:4f564953-49e2-4981-93bf-f185049701e2 nodeName:}" failed. No retries permitted until 2026-07-11 01:11:16.375856488 +0000 UTC m=+280.707332009 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/4f564953-49e2-4981-93bf-f185049701e2-node-exporter-tls") pod "node-exporter-5x9rv" (UID: "4f564953-49e2-4981-93bf-f185049701e2") : secret "node-exporter-tls" not found Jul 11 01:11:15.876027 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:15.875786 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4f564953-49e2-4981-93bf-f185049701e2-sys\") pod \"node-exporter-5x9rv\" (UID: \"4f564953-49e2-4981-93bf-f185049701e2\") " pod="openshift-monitoring/node-exporter-5x9rv" Jul 11 01:11:15.876027 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:15.875896 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r87jg\" (UniqueName: \"kubernetes.io/projected/4f564953-49e2-4981-93bf-f185049701e2-kube-api-access-r87jg\") pod \"node-exporter-5x9rv\" (UID: \"4f564953-49e2-4981-93bf-f185049701e2\") " pod="openshift-monitoring/node-exporter-5x9rv" Jul 11 01:11:15.876027 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:15.875928 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4f564953-49e2-4981-93bf-f185049701e2-node-exporter-wtmp\") pod \"node-exporter-5x9rv\" (UID: \"4f564953-49e2-4981-93bf-f185049701e2\") " pod="openshift-monitoring/node-exporter-5x9rv" Jul 11 01:11:15.876364 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:15.876096 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4f564953-49e2-4981-93bf-f185049701e2-node-exporter-textfile\") pod \"node-exporter-5x9rv\" (UID: \"4f564953-49e2-4981-93bf-f185049701e2\") " pod="openshift-monitoring/node-exporter-5x9rv" Jul 11 01:11:15.876364 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:15.876291 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f564953-49e2-4981-93bf-f185049701e2-metrics-client-ca\") pod \"node-exporter-5x9rv\" (UID: \"4f564953-49e2-4981-93bf-f185049701e2\") " pod="openshift-monitoring/node-exporter-5x9rv" Jul 11 01:11:15.876473 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:15.876366 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4f564953-49e2-4981-93bf-f185049701e2-node-exporter-accelerators-collector-config\") pod \"node-exporter-5x9rv\" (UID: \"4f564953-49e2-4981-93bf-f185049701e2\") " pod="openshift-monitoring/node-exporter-5x9rv" Jul 11 01:11:15.877938 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:15.877916 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4f564953-49e2-4981-93bf-f185049701e2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5x9rv\" (UID: \"4f564953-49e2-4981-93bf-f185049701e2\") " pod="openshift-monitoring/node-exporter-5x9rv" Jul 11 01:11:15.887053 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:15.887034 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r87jg\" (UniqueName: \"kubernetes.io/projected/4f564953-49e2-4981-93bf-f185049701e2-kube-api-access-r87jg\") pod \"node-exporter-5x9rv\" (UID: \"4f564953-49e2-4981-93bf-f185049701e2\") " pod="openshift-monitoring/node-exporter-5x9rv" Jul 11 01:11:16.380637 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:16.380591 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4f564953-49e2-4981-93bf-f185049701e2-node-exporter-tls\") pod \"node-exporter-5x9rv\" (UID: \"4f564953-49e2-4981-93bf-f185049701e2\") " pod="openshift-monitoring/node-exporter-5x9rv" Jul 11 01:11:16.383054 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:16.383028 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4f564953-49e2-4981-93bf-f185049701e2-node-exporter-tls\") pod \"node-exporter-5x9rv\" (UID: \"4f564953-49e2-4981-93bf-f185049701e2\") " pod="openshift-monitoring/node-exporter-5x9rv" Jul 11 01:11:16.578917 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:16.578877 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5x9rv" Jul 11 01:11:16.590902 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:11:16.590876 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f564953_49e2_4981_93bf_f185049701e2.slice/crio-ae3f588541d3914bade1acb9d7eac6361b0c5e749234d6f27494041bf9253e9e WatchSource:0}: Error finding container ae3f588541d3914bade1acb9d7eac6361b0c5e749234d6f27494041bf9253e9e: Status 404 returned error can't find the container with id ae3f588541d3914bade1acb9d7eac6361b0c5e749234d6f27494041bf9253e9e Jul 11 01:11:17.000038 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:11:16.999999 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-m8drm" podUID="dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64" Jul 11 01:11:17.348099 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:17.348021 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-m8drm" Jul 11 01:11:17.348099 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:17.348038 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5x9rv" event={"ID":"4f564953-49e2-4981-93bf-f185049701e2","Type":"ContainerStarted","Data":"ae3f588541d3914bade1acb9d7eac6361b0c5e749234d6f27494041bf9253e9e"} Jul 11 01:11:18.352965 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:18.352928 2572 generic.go:356] "Generic (PLEG): container finished" podID="4f564953-49e2-4981-93bf-f185049701e2" containerID="82ef99546ef1559b5d1bae4b6fda94bf60ae2bac25e540bb6db7e26a91595669" exitCode=0 Jul 11 01:11:18.353350 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:18.352971 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5x9rv" event={"ID":"4f564953-49e2-4981-93bf-f185049701e2","Type":"ContainerDied","Data":"82ef99546ef1559b5d1bae4b6fda94bf60ae2bac25e540bb6db7e26a91595669"} Jul 11 01:11:19.358439 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:19.358394 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5x9rv" event={"ID":"4f564953-49e2-4981-93bf-f185049701e2","Type":"ContainerStarted","Data":"fa7e2ac8820d198c548620b083429b636cea234c5ac0b9aaf9eca5e9a0197cba"} Jul 11 01:11:19.358883 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:19.358460 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5x9rv" event={"ID":"4f564953-49e2-4981-93bf-f185049701e2","Type":"ContainerStarted","Data":"c7a06869440b030785b3c43527edc8b8f0b7a270267f1bd97b6d601c5b76260b"} Jul 11 01:11:19.377215 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:19.377168 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5x9rv" podStartSLOduration=3.252252528 podStartE2EDuration="4.377153458s" totalImagesPullingTime="1.061527357s" totalInitContainerRuntime="63.373573ms" isStatefulPod=true podCreationTimestamp="2026-07-11 01:11:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:11:19.375623433 +0000 UTC m=+283.707098976" watchObservedRunningTime="2026-07-11 01:11:19.377153458 +0000 UTC m=+283.708629033" Jul 11 01:11:20.013543 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:20.013508 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-64889dfb8c-v7hq8"] Jul 11 01:11:20.016433 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:20.016416 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-64889dfb8c-v7hq8" Jul 11 01:11:20.018792 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:20.018770 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 11 01:11:20.018878 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:20.018799 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-491h2vo4ilrcl\"" Jul 11 01:11:20.019807 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:20.019776 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 11 01:11:20.019807 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:20.019797 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-4p4cq\"" Jul 11 01:11:20.019953 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:20.019835 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 11 01:11:20.019953 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:20.019867 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 11 01:11:20.026674 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:20.026654 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-64889dfb8c-v7hq8"] Jul 11 01:11:20.109619 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:20.109573 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7b3e9af6-7640-4eb5-9bb0-6f7926523f5f-client-ca-bundle\") pod \"metrics-server-64889dfb8c-v7hq8\" (UID: \"7b3e9af6-7640-4eb5-9bb0-6f7926523f5f\") " pod="openshift-monitoring/metrics-server-64889dfb8c-v7hq8" Jul 11 01:11:20.109619 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:20.109620 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7b3e9af6-7640-4eb5-9bb0-6f7926523f5f-audit-log\") pod \"metrics-server-64889dfb8c-v7hq8\" (UID: \"7b3e9af6-7640-4eb5-9bb0-6f7926523f5f\") " pod="openshift-monitoring/metrics-server-64889dfb8c-v7hq8" Jul 11 01:11:20.109849 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:20.109648 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7b3e9af6-7640-4eb5-9bb0-6f7926523f5f-metrics-server-audit-profiles\") pod \"metrics-server-64889dfb8c-v7hq8\" (UID: \"7b3e9af6-7640-4eb5-9bb0-6f7926523f5f\") " pod="openshift-monitoring/metrics-server-64889dfb8c-v7hq8" Jul 11 01:11:20.113514 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:20.109872 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7b3e9af6-7640-4eb5-9bb0-6f7926523f5f-secret-metrics-server-tls\") pod \"metrics-server-64889dfb8c-v7hq8\" (UID: \"7b3e9af6-7640-4eb5-9bb0-6f7926523f5f\") " pod="openshift-monitoring/metrics-server-64889dfb8c-v7hq8" Jul 11 01:11:20.113514 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:20.110187 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87l2n\" (UniqueName: \"kubernetes.io/projected/7b3e9af6-7640-4eb5-9bb0-6f7926523f5f-kube-api-access-87l2n\") pod \"metrics-server-64889dfb8c-v7hq8\" (UID: \"7b3e9af6-7640-4eb5-9bb0-6f7926523f5f\") " pod="openshift-monitoring/metrics-server-64889dfb8c-v7hq8" Jul 11 01:11:20.113514 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:20.110229 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b3e9af6-7640-4eb5-9bb0-6f7926523f5f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-64889dfb8c-v7hq8\" (UID: \"7b3e9af6-7640-4eb5-9bb0-6f7926523f5f\") " pod="openshift-monitoring/metrics-server-64889dfb8c-v7hq8" Jul 11 01:11:20.113514 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:20.110295 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7b3e9af6-7640-4eb5-9bb0-6f7926523f5f-secret-metrics-server-client-certs\") pod \"metrics-server-64889dfb8c-v7hq8\" (UID: \"7b3e9af6-7640-4eb5-9bb0-6f7926523f5f\") " pod="openshift-monitoring/metrics-server-64889dfb8c-v7hq8" Jul 11 01:11:20.211000 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:20.210951 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7b3e9af6-7640-4eb5-9bb0-6f7926523f5f-secret-metrics-server-client-certs\") pod \"metrics-server-64889dfb8c-v7hq8\" (UID: \"7b3e9af6-7640-4eb5-9bb0-6f7926523f5f\") " pod="openshift-monitoring/metrics-server-64889dfb8c-v7hq8" Jul 11 01:11:20.211144 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:20.211015 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7b3e9af6-7640-4eb5-9bb0-6f7926523f5f-client-ca-bundle\") pod \"metrics-server-64889dfb8c-v7hq8\" (UID: \"7b3e9af6-7640-4eb5-9bb0-6f7926523f5f\") " pod="openshift-monitoring/metrics-server-64889dfb8c-v7hq8" Jul 11 01:11:20.211144 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:20.211039 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7b3e9af6-7640-4eb5-9bb0-6f7926523f5f-audit-log\") pod \"metrics-server-64889dfb8c-v7hq8\" (UID: \"7b3e9af6-7640-4eb5-9bb0-6f7926523f5f\") " pod="openshift-monitoring/metrics-server-64889dfb8c-v7hq8" Jul 11 01:11:20.211144 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:20.211060 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7b3e9af6-7640-4eb5-9bb0-6f7926523f5f-metrics-server-audit-profiles\") pod \"metrics-server-64889dfb8c-v7hq8\" (UID: \"7b3e9af6-7640-4eb5-9bb0-6f7926523f5f\") " pod="openshift-monitoring/metrics-server-64889dfb8c-v7hq8" Jul 11 01:11:20.211144 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:20.211078 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7b3e9af6-7640-4eb5-9bb0-6f7926523f5f-secret-metrics-server-tls\") pod \"metrics-server-64889dfb8c-v7hq8\" (UID: \"7b3e9af6-7640-4eb5-9bb0-6f7926523f5f\") " pod="openshift-monitoring/metrics-server-64889dfb8c-v7hq8" Jul 11 01:11:20.211144 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:20.211129 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87l2n\" (UniqueName: \"kubernetes.io/projected/7b3e9af6-7640-4eb5-9bb0-6f7926523f5f-kube-api-access-87l2n\") pod \"metrics-server-64889dfb8c-v7hq8\" (UID: \"7b3e9af6-7640-4eb5-9bb0-6f7926523f5f\") " pod="openshift-monitoring/metrics-server-64889dfb8c-v7hq8" Jul 11 01:11:20.211397 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:20.211154 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b3e9af6-7640-4eb5-9bb0-6f7926523f5f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-64889dfb8c-v7hq8\" (UID: \"7b3e9af6-7640-4eb5-9bb0-6f7926523f5f\") " pod="openshift-monitoring/metrics-server-64889dfb8c-v7hq8" Jul 11 01:11:20.211519 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:20.211496 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7b3e9af6-7640-4eb5-9bb0-6f7926523f5f-audit-log\") pod \"metrics-server-64889dfb8c-v7hq8\" (UID: \"7b3e9af6-7640-4eb5-9bb0-6f7926523f5f\") " pod="openshift-monitoring/metrics-server-64889dfb8c-v7hq8" Jul 11 01:11:20.211961 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:20.211935 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b3e9af6-7640-4eb5-9bb0-6f7926523f5f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-64889dfb8c-v7hq8\" (UID: \"7b3e9af6-7640-4eb5-9bb0-6f7926523f5f\") " pod="openshift-monitoring/metrics-server-64889dfb8c-v7hq8" Jul 11 01:11:20.212168 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:20.212152 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7b3e9af6-7640-4eb5-9bb0-6f7926523f5f-metrics-server-audit-profiles\") pod \"metrics-server-64889dfb8c-v7hq8\" (UID: \"7b3e9af6-7640-4eb5-9bb0-6f7926523f5f\") " pod="openshift-monitoring/metrics-server-64889dfb8c-v7hq8" Jul 11 01:11:20.213581 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:20.213557 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7b3e9af6-7640-4eb5-9bb0-6f7926523f5f-secret-metrics-server-tls\") pod \"metrics-server-64889dfb8c-v7hq8\" (UID: \"7b3e9af6-7640-4eb5-9bb0-6f7926523f5f\") " pod="openshift-monitoring/metrics-server-64889dfb8c-v7hq8" Jul 11 01:11:20.213932 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:20.213915 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7b3e9af6-7640-4eb5-9bb0-6f7926523f5f-client-ca-bundle\") pod \"metrics-server-64889dfb8c-v7hq8\" (UID: \"7b3e9af6-7640-4eb5-9bb0-6f7926523f5f\") " pod="openshift-monitoring/metrics-server-64889dfb8c-v7hq8" Jul 11 01:11:20.213994 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:20.213976 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7b3e9af6-7640-4eb5-9bb0-6f7926523f5f-secret-metrics-server-client-certs\") pod \"metrics-server-64889dfb8c-v7hq8\" (UID: \"7b3e9af6-7640-4eb5-9bb0-6f7926523f5f\") " pod="openshift-monitoring/metrics-server-64889dfb8c-v7hq8" Jul 11 01:11:20.217948 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:20.217931 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-87l2n\" (UniqueName: \"kubernetes.io/projected/7b3e9af6-7640-4eb5-9bb0-6f7926523f5f-kube-api-access-87l2n\") pod \"metrics-server-64889dfb8c-v7hq8\" (UID: \"7b3e9af6-7640-4eb5-9bb0-6f7926523f5f\") " pod="openshift-monitoring/metrics-server-64889dfb8c-v7hq8" Jul 11 01:11:20.326145 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:20.326041 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-64889dfb8c-v7hq8" Jul 11 01:11:20.413665 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:20.413550 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64-metrics-tls\") pod \"dns-default-m8drm\" (UID: \"dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64\") " pod="openshift-dns/dns-default-m8drm" Jul 11 01:11:20.415707 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:20.415660 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64-metrics-tls\") pod \"dns-default-m8drm\" (UID: \"dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64\") " pod="openshift-dns/dns-default-m8drm" Jul 11 01:11:20.462533 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:20.462500 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-64889dfb8c-v7hq8"] Jul 11 01:11:20.466501 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:11:20.466470 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b3e9af6_7640_4eb5_9bb0_6f7926523f5f.slice/crio-61e3f59797a387c41d400f4dc5186799dc51528b4c8b6dad29319f28143657ea WatchSource:0}: Error finding container 61e3f59797a387c41d400f4dc5186799dc51528b4c8b6dad29319f28143657ea: Status 404 returned error can't find the container with id 61e3f59797a387c41d400f4dc5186799dc51528b4c8b6dad29319f28143657ea Jul 11 01:11:20.651298 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:20.651219 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nzrhh\"" Jul 11 01:11:20.660065 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:20.660044 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-m8drm" Jul 11 01:11:20.784610 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:20.784579 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-m8drm"] Jul 11 01:11:20.787271 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:11:20.787247 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd1ab9c5_e4ae_417a_ae29_1b4fa8de7d64.slice/crio-cb2542da0e21de5680a9f4af3c3fe3e9ee187bfe43493a6cd8b9de11bebdcf38 WatchSource:0}: Error finding container cb2542da0e21de5680a9f4af3c3fe3e9ee187bfe43493a6cd8b9de11bebdcf38: Status 404 returned error can't find the container with id cb2542da0e21de5680a9f4af3c3fe3e9ee187bfe43493a6cd8b9de11bebdcf38 Jul 11 01:11:21.295911 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:21.295874 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-57bf475f95-qf72c" Jul 11 01:11:21.367783 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:21.367746 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-64889dfb8c-v7hq8" event={"ID":"7b3e9af6-7640-4eb5-9bb0-6f7926523f5f","Type":"ContainerStarted","Data":"61e3f59797a387c41d400f4dc5186799dc51528b4c8b6dad29319f28143657ea"} Jul 11 01:11:21.369121 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:21.369079 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-m8drm" event={"ID":"dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64","Type":"ContainerStarted","Data":"cb2542da0e21de5680a9f4af3c3fe3e9ee187bfe43493a6cd8b9de11bebdcf38"} Jul 11 01:11:22.374481 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:22.374376 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-64889dfb8c-v7hq8" event={"ID":"7b3e9af6-7640-4eb5-9bb0-6f7926523f5f","Type":"ContainerStarted","Data":"8ffd7bf03f15fa3dd23c7041dedf4ee55e97cffd6ca8b0e6af9d70fc952ee914"} Jul 11 01:11:22.397911 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:22.397848 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-64889dfb8c-v7hq8" podStartSLOduration=1.871585836 podStartE2EDuration="3.397826446s" totalImagesPullingTime="1.52624061s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:11:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:11:22.396775523 +0000 UTC m=+286.728251097" watchObservedRunningTime="2026-07-11 01:11:22.397826446 +0000 UTC m=+286.729301992" Jul 11 01:11:23.379663 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:23.379630 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-m8drm" event={"ID":"dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64","Type":"ContainerStarted","Data":"449977101b11db396151e6012281de00d517f390e04651be7002a32a36dd6070"} Jul 11 01:11:23.380088 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:23.379682 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-m8drm" event={"ID":"dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64","Type":"ContainerStarted","Data":"0c5639bca8f903319948850c5277ed3e50704e515e9fa424c6aa4aa4aa826acf"} Jul 11 01:11:23.380088 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:23.379954 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-m8drm" Jul 11 01:11:23.395458 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:23.395406 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-m8drm" podStartSLOduration=251.43714154 podStartE2EDuration="4m13.395384963s" totalImagesPullingTime="1.958243423s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:07:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:11:23.394032153 +0000 UTC m=+287.725507712" watchObservedRunningTime="2026-07-11 01:11:23.395384963 +0000 UTC m=+287.726860508" Jul 11 01:11:31.455543 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:31.455505 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5bc59fbd64-p95hj"] Jul 11 01:11:31.458577 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:31.458559 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bc59fbd64-p95hj" Jul 11 01:11:31.460978 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:31.460955 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 11 01:11:31.462012 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:31.461992 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 11 01:11:31.462100 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:31.461992 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 11 01:11:31.462100 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:31.462067 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-qcgjm\"" Jul 11 01:11:31.462624 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:31.462599 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 11 01:11:31.462795 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:31.462776 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 11 01:11:31.462946 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:31.462599 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 11 01:11:31.463058 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:31.463038 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 11 01:11:31.470230 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:31.470205 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5bc59fbd64-p95hj"] Jul 11 01:11:31.471090 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:31.471073 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 11 01:11:31.500785 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:31.500749 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bfe29e55-1057-4321-84e7-3e87e81edc6a-service-ca\") pod \"console-5bc59fbd64-p95hj\" (UID: \"bfe29e55-1057-4321-84e7-3e87e81edc6a\") " pod="openshift-console/console-5bc59fbd64-p95hj" Jul 11 01:11:31.500785 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:31.500788 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfe29e55-1057-4321-84e7-3e87e81edc6a-trusted-ca-bundle\") pod \"console-5bc59fbd64-p95hj\" (UID: \"bfe29e55-1057-4321-84e7-3e87e81edc6a\") " pod="openshift-console/console-5bc59fbd64-p95hj" Jul 11 01:11:31.500974 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:31.500864 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bfe29e55-1057-4321-84e7-3e87e81edc6a-oauth-serving-cert\") pod \"console-5bc59fbd64-p95hj\" (UID: \"bfe29e55-1057-4321-84e7-3e87e81edc6a\") " pod="openshift-console/console-5bc59fbd64-p95hj" Jul 11 01:11:31.500974 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:31.500949 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bfe29e55-1057-4321-84e7-3e87e81edc6a-console-config\") pod \"console-5bc59fbd64-p95hj\" (UID: \"bfe29e55-1057-4321-84e7-3e87e81edc6a\") " pod="openshift-console/console-5bc59fbd64-p95hj" Jul 11 01:11:31.501034 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:31.500982 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bfe29e55-1057-4321-84e7-3e87e81edc6a-console-oauth-config\") pod \"console-5bc59fbd64-p95hj\" (UID: \"bfe29e55-1057-4321-84e7-3e87e81edc6a\") " pod="openshift-console/console-5bc59fbd64-p95hj" Jul 11 01:11:31.501034 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:31.501014 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvgnm\" (UniqueName: \"kubernetes.io/projected/bfe29e55-1057-4321-84e7-3e87e81edc6a-kube-api-access-hvgnm\") pod \"console-5bc59fbd64-p95hj\" (UID: \"bfe29e55-1057-4321-84e7-3e87e81edc6a\") " pod="openshift-console/console-5bc59fbd64-p95hj" Jul 11 01:11:31.501109 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:31.501036 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bfe29e55-1057-4321-84e7-3e87e81edc6a-console-serving-cert\") pod \"console-5bc59fbd64-p95hj\" (UID: \"bfe29e55-1057-4321-84e7-3e87e81edc6a\") " pod="openshift-console/console-5bc59fbd64-p95hj" Jul 11 01:11:31.601923 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:31.601886 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bfe29e55-1057-4321-84e7-3e87e81edc6a-oauth-serving-cert\") pod \"console-5bc59fbd64-p95hj\" (UID: \"bfe29e55-1057-4321-84e7-3e87e81edc6a\") " pod="openshift-console/console-5bc59fbd64-p95hj" Jul 11 01:11:31.602074 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:31.601933 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bfe29e55-1057-4321-84e7-3e87e81edc6a-console-config\") pod \"console-5bc59fbd64-p95hj\" (UID: \"bfe29e55-1057-4321-84e7-3e87e81edc6a\") " pod="openshift-console/console-5bc59fbd64-p95hj" Jul 11 01:11:31.602074 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:31.601951 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bfe29e55-1057-4321-84e7-3e87e81edc6a-console-oauth-config\") pod \"console-5bc59fbd64-p95hj\" (UID: \"bfe29e55-1057-4321-84e7-3e87e81edc6a\") " pod="openshift-console/console-5bc59fbd64-p95hj" Jul 11 01:11:31.602173 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:31.602075 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvgnm\" (UniqueName: \"kubernetes.io/projected/bfe29e55-1057-4321-84e7-3e87e81edc6a-kube-api-access-hvgnm\") pod \"console-5bc59fbd64-p95hj\" (UID: \"bfe29e55-1057-4321-84e7-3e87e81edc6a\") " pod="openshift-console/console-5bc59fbd64-p95hj" Jul 11 01:11:31.602173 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:31.602117 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bfe29e55-1057-4321-84e7-3e87e81edc6a-console-serving-cert\") pod \"console-5bc59fbd64-p95hj\" (UID: \"bfe29e55-1057-4321-84e7-3e87e81edc6a\") " pod="openshift-console/console-5bc59fbd64-p95hj" Jul 11 01:11:31.602263 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:31.602168 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bfe29e55-1057-4321-84e7-3e87e81edc6a-service-ca\") pod \"console-5bc59fbd64-p95hj\" (UID: \"bfe29e55-1057-4321-84e7-3e87e81edc6a\") " pod="openshift-console/console-5bc59fbd64-p95hj" Jul 11 01:11:31.602263 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:31.602197 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfe29e55-1057-4321-84e7-3e87e81edc6a-trusted-ca-bundle\") pod \"console-5bc59fbd64-p95hj\" (UID: \"bfe29e55-1057-4321-84e7-3e87e81edc6a\") " pod="openshift-console/console-5bc59fbd64-p95hj" Jul 11 01:11:31.602808 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:31.602777 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bfe29e55-1057-4321-84e7-3e87e81edc6a-console-config\") pod \"console-5bc59fbd64-p95hj\" (UID: \"bfe29e55-1057-4321-84e7-3e87e81edc6a\") " pod="openshift-console/console-5bc59fbd64-p95hj" Jul 11 01:11:31.602939 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:31.602848 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bfe29e55-1057-4321-84e7-3e87e81edc6a-oauth-serving-cert\") pod \"console-5bc59fbd64-p95hj\" (UID: \"bfe29e55-1057-4321-84e7-3e87e81edc6a\") " pod="openshift-console/console-5bc59fbd64-p95hj" Jul 11 01:11:31.602939 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:31.602890 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bfe29e55-1057-4321-84e7-3e87e81edc6a-service-ca\") pod \"console-5bc59fbd64-p95hj\" (UID: \"bfe29e55-1057-4321-84e7-3e87e81edc6a\") " pod="openshift-console/console-5bc59fbd64-p95hj" Jul 11 01:11:31.603131 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:31.603112 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfe29e55-1057-4321-84e7-3e87e81edc6a-trusted-ca-bundle\") pod \"console-5bc59fbd64-p95hj\" (UID: \"bfe29e55-1057-4321-84e7-3e87e81edc6a\") " pod="openshift-console/console-5bc59fbd64-p95hj" Jul 11 01:11:31.604382 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:31.604362 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bfe29e55-1057-4321-84e7-3e87e81edc6a-console-oauth-config\") pod \"console-5bc59fbd64-p95hj\" (UID: \"bfe29e55-1057-4321-84e7-3e87e81edc6a\") " pod="openshift-console/console-5bc59fbd64-p95hj" Jul 11 01:11:31.604664 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:31.604644 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bfe29e55-1057-4321-84e7-3e87e81edc6a-console-serving-cert\") pod \"console-5bc59fbd64-p95hj\" (UID: \"bfe29e55-1057-4321-84e7-3e87e81edc6a\") " pod="openshift-console/console-5bc59fbd64-p95hj" Jul 11 01:11:31.609431 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:31.609404 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvgnm\" (UniqueName: \"kubernetes.io/projected/bfe29e55-1057-4321-84e7-3e87e81edc6a-kube-api-access-hvgnm\") pod \"console-5bc59fbd64-p95hj\" (UID: \"bfe29e55-1057-4321-84e7-3e87e81edc6a\") " pod="openshift-console/console-5bc59fbd64-p95hj" Jul 11 01:11:31.770919 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:31.770817 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bc59fbd64-p95hj" Jul 11 01:11:31.909153 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:31.909121 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5bc59fbd64-p95hj"] Jul 11 01:11:31.911895 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:11:31.911867 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfe29e55_1057_4321_84e7_3e87e81edc6a.slice/crio-55060bf8dcd2f6dce821d9735e40584558457acc7002f5e8d925783ba04f75ea WatchSource:0}: Error finding container 55060bf8dcd2f6dce821d9735e40584558457acc7002f5e8d925783ba04f75ea: Status 404 returned error can't find the container with id 55060bf8dcd2f6dce821d9735e40584558457acc7002f5e8d925783ba04f75ea Jul 11 01:11:32.252630 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:11:32.252589 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-4j8b6" podUID="6de25e6a-b433-4f08-941a-9666d215fe54" Jul 11 01:11:32.409416 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:32.409380 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bc59fbd64-p95hj" event={"ID":"bfe29e55-1057-4321-84e7-3e87e81edc6a","Type":"ContainerStarted","Data":"55060bf8dcd2f6dce821d9735e40584558457acc7002f5e8d925783ba04f75ea"} Jul 11 01:11:33.385722 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:33.385673 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-m8drm" Jul 11 01:11:35.422628 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:35.422594 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bc59fbd64-p95hj" event={"ID":"bfe29e55-1057-4321-84e7-3e87e81edc6a","Type":"ContainerStarted","Data":"f088adb4898d1e5f1bf9bc0c7077f8e747bf33ed7705dc4f18d547fd96217fa7"} Jul 11 01:11:35.438471 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:35.438375 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5bc59fbd64-p95hj" podStartSLOduration=1.6813109910000001 podStartE2EDuration="4.438355814s" totalImagesPullingTime="2.757044823s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:11:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:11:35.438076088 +0000 UTC m=+299.769551645" watchObservedRunningTime="2026-07-11 01:11:35.438355814 +0000 UTC m=+299.769831359" Jul 11 01:11:36.090386 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:36.090363 2572 kubelet.go:1648] "Image garbage collection succeeded" Jul 11 01:11:40.326642 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:40.326598 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-64889dfb8c-v7hq8" Jul 11 01:11:40.331276 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:40.326655 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-64889dfb8c-v7hq8" Jul 11 01:11:41.771534 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:41.771488 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5bc59fbd64-p95hj" Jul 11 01:11:41.772002 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:41.771560 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5bc59fbd64-p95hj" Jul 11 01:11:41.776523 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:41.776499 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5bc59fbd64-p95hj" Jul 11 01:11:42.449899 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:42.449868 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5bc59fbd64-p95hj" Jul 11 01:11:43.251183 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:11:43.251137 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4j8b6" Jul 11 01:12:00.331780 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:12:00.331747 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-64889dfb8c-v7hq8" Jul 11 01:12:00.335907 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:12:00.335889 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-64889dfb8c-v7hq8" Jul 11 01:12:44.227418 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:12:44.227344 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-574645f4fb-hqqq2"] Jul 11 01:12:44.230357 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:12:44.230341 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-574645f4fb-hqqq2" Jul 11 01:12:44.240814 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:12:44.240788 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-574645f4fb-hqqq2"] Jul 11 01:12:44.382629 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:12:44.382585 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hclj\" (UniqueName: \"kubernetes.io/projected/674bdf43-f748-4dc3-a54a-31091c395941-kube-api-access-2hclj\") pod \"console-574645f4fb-hqqq2\" (UID: \"674bdf43-f748-4dc3-a54a-31091c395941\") " pod="openshift-console/console-574645f4fb-hqqq2" Jul 11 01:12:44.382629 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:12:44.382632 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/674bdf43-f748-4dc3-a54a-31091c395941-console-oauth-config\") pod \"console-574645f4fb-hqqq2\" (UID: \"674bdf43-f748-4dc3-a54a-31091c395941\") " pod="openshift-console/console-574645f4fb-hqqq2" Jul 11 01:12:44.382897 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:12:44.382724 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/674bdf43-f748-4dc3-a54a-31091c395941-trusted-ca-bundle\") pod \"console-574645f4fb-hqqq2\" (UID: \"674bdf43-f748-4dc3-a54a-31091c395941\") " pod="openshift-console/console-574645f4fb-hqqq2" Jul 11 01:12:44.382897 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:12:44.382759 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/674bdf43-f748-4dc3-a54a-31091c395941-service-ca\") pod \"console-574645f4fb-hqqq2\" (UID: \"674bdf43-f748-4dc3-a54a-31091c395941\") " pod="openshift-console/console-574645f4fb-hqqq2" Jul 11 01:12:44.382897 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:12:44.382790 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/674bdf43-f748-4dc3-a54a-31091c395941-oauth-serving-cert\") pod \"console-574645f4fb-hqqq2\" (UID: \"674bdf43-f748-4dc3-a54a-31091c395941\") " pod="openshift-console/console-574645f4fb-hqqq2" Jul 11 01:12:44.382897 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:12:44.382819 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/674bdf43-f748-4dc3-a54a-31091c395941-console-serving-cert\") pod \"console-574645f4fb-hqqq2\" (UID: \"674bdf43-f748-4dc3-a54a-31091c395941\") " pod="openshift-console/console-574645f4fb-hqqq2" Jul 11 01:12:44.383022 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:12:44.382919 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/674bdf43-f748-4dc3-a54a-31091c395941-console-config\") pod \"console-574645f4fb-hqqq2\" (UID: \"674bdf43-f748-4dc3-a54a-31091c395941\") " pod="openshift-console/console-574645f4fb-hqqq2" Jul 11 01:12:44.484250 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:12:44.484164 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/674bdf43-f748-4dc3-a54a-31091c395941-console-config\") pod \"console-574645f4fb-hqqq2\" (UID: \"674bdf43-f748-4dc3-a54a-31091c395941\") " pod="openshift-console/console-574645f4fb-hqqq2" Jul 11 01:12:44.484250 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:12:44.484230 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hclj\" (UniqueName: \"kubernetes.io/projected/674bdf43-f748-4dc3-a54a-31091c395941-kube-api-access-2hclj\") pod \"console-574645f4fb-hqqq2\" (UID: \"674bdf43-f748-4dc3-a54a-31091c395941\") " pod="openshift-console/console-574645f4fb-hqqq2" Jul 11 01:12:44.484250 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:12:44.484250 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/674bdf43-f748-4dc3-a54a-31091c395941-console-oauth-config\") pod \"console-574645f4fb-hqqq2\" (UID: \"674bdf43-f748-4dc3-a54a-31091c395941\") " pod="openshift-console/console-574645f4fb-hqqq2" Jul 11 01:12:44.484496 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:12:44.484279 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/674bdf43-f748-4dc3-a54a-31091c395941-trusted-ca-bundle\") pod \"console-574645f4fb-hqqq2\" (UID: \"674bdf43-f748-4dc3-a54a-31091c395941\") " pod="openshift-console/console-574645f4fb-hqqq2" Jul 11 01:12:44.484496 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:12:44.484295 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/674bdf43-f748-4dc3-a54a-31091c395941-service-ca\") pod \"console-574645f4fb-hqqq2\" (UID: \"674bdf43-f748-4dc3-a54a-31091c395941\") " pod="openshift-console/console-574645f4fb-hqqq2" Jul 11 01:12:44.484496 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:12:44.484321 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/674bdf43-f748-4dc3-a54a-31091c395941-oauth-serving-cert\") pod \"console-574645f4fb-hqqq2\" (UID: \"674bdf43-f748-4dc3-a54a-31091c395941\") " pod="openshift-console/console-574645f4fb-hqqq2" Jul 11 01:12:44.484496 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:12:44.484352 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/674bdf43-f748-4dc3-a54a-31091c395941-console-serving-cert\") pod \"console-574645f4fb-hqqq2\" (UID: \"674bdf43-f748-4dc3-a54a-31091c395941\") " pod="openshift-console/console-574645f4fb-hqqq2" Jul 11 01:12:44.485123 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:12:44.485095 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/674bdf43-f748-4dc3-a54a-31091c395941-service-ca\") pod \"console-574645f4fb-hqqq2\" (UID: \"674bdf43-f748-4dc3-a54a-31091c395941\") " pod="openshift-console/console-574645f4fb-hqqq2" Jul 11 01:12:44.485301 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:12:44.485096 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/674bdf43-f748-4dc3-a54a-31091c395941-console-config\") pod \"console-574645f4fb-hqqq2\" (UID: \"674bdf43-f748-4dc3-a54a-31091c395941\") " pod="openshift-console/console-574645f4fb-hqqq2" Jul 11 01:12:44.485301 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:12:44.485129 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/674bdf43-f748-4dc3-a54a-31091c395941-oauth-serving-cert\") pod \"console-574645f4fb-hqqq2\" (UID: \"674bdf43-f748-4dc3-a54a-31091c395941\") " pod="openshift-console/console-574645f4fb-hqqq2" Jul 11 01:12:44.485430 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:12:44.485150 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/674bdf43-f748-4dc3-a54a-31091c395941-trusted-ca-bundle\") pod \"console-574645f4fb-hqqq2\" (UID: \"674bdf43-f748-4dc3-a54a-31091c395941\") " pod="openshift-console/console-574645f4fb-hqqq2" Jul 11 01:12:44.486844 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:12:44.486820 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/674bdf43-f748-4dc3-a54a-31091c395941-console-oauth-config\") pod \"console-574645f4fb-hqqq2\" (UID: \"674bdf43-f748-4dc3-a54a-31091c395941\") " pod="openshift-console/console-574645f4fb-hqqq2" Jul 11 01:12:44.486904 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:12:44.486870 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/674bdf43-f748-4dc3-a54a-31091c395941-console-serving-cert\") pod \"console-574645f4fb-hqqq2\" (UID: \"674bdf43-f748-4dc3-a54a-31091c395941\") " pod="openshift-console/console-574645f4fb-hqqq2" Jul 11 01:12:44.491962 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:12:44.491940 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hclj\" (UniqueName: \"kubernetes.io/projected/674bdf43-f748-4dc3-a54a-31091c395941-kube-api-access-2hclj\") pod \"console-574645f4fb-hqqq2\" (UID: \"674bdf43-f748-4dc3-a54a-31091c395941\") " pod="openshift-console/console-574645f4fb-hqqq2" Jul 11 01:12:44.539926 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:12:44.539900 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-574645f4fb-hqqq2" Jul 11 01:12:44.665991 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:12:44.665868 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-574645f4fb-hqqq2"] Jul 11 01:12:44.668581 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:12:44.668553 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod674bdf43_f748_4dc3_a54a_31091c395941.slice/crio-6ebc300cf85fd1ce669f8828f75a4912b054b16468c3461ccf2c9892698f3543 WatchSource:0}: Error finding container 6ebc300cf85fd1ce669f8828f75a4912b054b16468c3461ccf2c9892698f3543: Status 404 returned error can't find the container with id 6ebc300cf85fd1ce669f8828f75a4912b054b16468c3461ccf2c9892698f3543 Jul 11 01:12:45.648767 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:12:45.648729 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-574645f4fb-hqqq2" event={"ID":"674bdf43-f748-4dc3-a54a-31091c395941","Type":"ContainerStarted","Data":"cb4df4c9a4b2b27c4add1dd4ad63b0d9ea85c24819cc538246a5d89a3919d543"} Jul 11 01:12:45.649238 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:12:45.648790 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-574645f4fb-hqqq2" event={"ID":"674bdf43-f748-4dc3-a54a-31091c395941","Type":"ContainerStarted","Data":"6ebc300cf85fd1ce669f8828f75a4912b054b16468c3461ccf2c9892698f3543"} Jul 11 01:12:45.666237 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:12:45.666181 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-574645f4fb-hqqq2" podStartSLOduration=1.666165457 podStartE2EDuration="1.666165457s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:12:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:12:45.66508487 +0000 UTC m=+369.996560414" watchObservedRunningTime="2026-07-11 01:12:45.666165457 +0000 UTC m=+369.997641078" Jul 11 01:12:49.120906 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:12:49.120861 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6de25e6a-b433-4f08-941a-9666d215fe54-metrics-certs\") pod \"network-metrics-daemon-4j8b6\" (UID: \"6de25e6a-b433-4f08-941a-9666d215fe54\") " pod="openshift-multus/network-metrics-daemon-4j8b6" Jul 11 01:12:49.123163 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:12:49.123142 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6de25e6a-b433-4f08-941a-9666d215fe54-metrics-certs\") pod \"network-metrics-daemon-4j8b6\" (UID: \"6de25e6a-b433-4f08-941a-9666d215fe54\") " pod="openshift-multus/network-metrics-daemon-4j8b6" Jul 11 01:12:49.255154 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:12:49.255122 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8ms55\"" Jul 11 01:12:49.262473 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:12:49.262452 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4j8b6" Jul 11 01:12:49.389303 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:12:49.389214 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4j8b6"] Jul 11 01:12:49.392354 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:12:49.392326 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6de25e6a_b433_4f08_941a_9666d215fe54.slice/crio-3ccfd167d6f454510468ef7ab161891a98f2cf0aea233e82c516a857bdcf7e05 WatchSource:0}: Error finding container 3ccfd167d6f454510468ef7ab161891a98f2cf0aea233e82c516a857bdcf7e05: Status 404 returned error can't find the container with id 3ccfd167d6f454510468ef7ab161891a98f2cf0aea233e82c516a857bdcf7e05 Jul 11 01:12:49.394470 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:12:49.394456 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 11 01:12:49.663326 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:12:49.663235 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4j8b6" event={"ID":"6de25e6a-b433-4f08-941a-9666d215fe54","Type":"ContainerStarted","Data":"3ccfd167d6f454510468ef7ab161891a98f2cf0aea233e82c516a857bdcf7e05"} Jul 11 01:12:50.668589 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:12:50.668509 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4j8b6" event={"ID":"6de25e6a-b433-4f08-941a-9666d215fe54","Type":"ContainerStarted","Data":"9c8ac9e37d0b9d7885fe58e007da8139a1dbbebcc78ee98b14e6d27f1d59c293"} Jul 11 01:12:50.668589 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:12:50.668566 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4j8b6" event={"ID":"6de25e6a-b433-4f08-941a-9666d215fe54","Type":"ContainerStarted","Data":"974f7364794a71ab58632e1ac2e57fb8f0313ec11a654999f2af0ddca448bb3d"} Jul 11 01:12:50.684435 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:12:50.684373 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-4j8b6" podStartSLOduration=373.66766354599997 podStartE2EDuration="6m14.684358768s" totalImagesPullingTime="1.016695222s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:06:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:12:50.68287181 +0000 UTC m=+375.014347395" watchObservedRunningTime="2026-07-11 01:12:50.684358768 +0000 UTC m=+375.015834311" Jul 11 01:12:54.540154 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:12:54.540115 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-574645f4fb-hqqq2" Jul 11 01:12:54.540643 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:12:54.540188 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-574645f4fb-hqqq2" Jul 11 01:12:54.544924 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:12:54.544900 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-574645f4fb-hqqq2" Jul 11 01:12:54.685506 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:12:54.685479 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-574645f4fb-hqqq2" Jul 11 01:12:54.727015 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:12:54.726985 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5bc59fbd64-p95hj"] Jul 11 01:13:19.747368 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:13:19.747312 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5bc59fbd64-p95hj" podUID="bfe29e55-1057-4321-84e7-3e87e81edc6a" containerName="console" containerID="cri-o://f088adb4898d1e5f1bf9bc0c7077f8e747bf33ed7705dc4f18d547fd96217fa7" gracePeriod=15 Jul 11 01:13:19.991563 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:13:19.991539 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bc59fbd64-p95hj" Jul 11 01:13:20.064722 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:13:20.064621 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bfe29e55-1057-4321-84e7-3e87e81edc6a-service-ca\") pod \"bfe29e55-1057-4321-84e7-3e87e81edc6a\" (UID: \"bfe29e55-1057-4321-84e7-3e87e81edc6a\") " Jul 11 01:13:20.064722 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:13:20.064654 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bfe29e55-1057-4321-84e7-3e87e81edc6a-console-config\") pod \"bfe29e55-1057-4321-84e7-3e87e81edc6a\" (UID: \"bfe29e55-1057-4321-84e7-3e87e81edc6a\") " Jul 11 01:13:20.064722 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:13:20.064685 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bfe29e55-1057-4321-84e7-3e87e81edc6a-oauth-serving-cert\") pod \"bfe29e55-1057-4321-84e7-3e87e81edc6a\" (UID: \"bfe29e55-1057-4321-84e7-3e87e81edc6a\") " Jul 11 01:13:20.064994 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:13:20.064725 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfe29e55-1057-4321-84e7-3e87e81edc6a-trusted-ca-bundle\") pod \"bfe29e55-1057-4321-84e7-3e87e81edc6a\" (UID: \"bfe29e55-1057-4321-84e7-3e87e81edc6a\") " Jul 11 01:13:20.064994 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:13:20.064751 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hvgnm\" (UniqueName: \"kubernetes.io/projected/bfe29e55-1057-4321-84e7-3e87e81edc6a-kube-api-access-hvgnm\") pod \"bfe29e55-1057-4321-84e7-3e87e81edc6a\" (UID: \"bfe29e55-1057-4321-84e7-3e87e81edc6a\") " Jul 11 01:13:20.064994 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:13:20.064779 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bfe29e55-1057-4321-84e7-3e87e81edc6a-console-serving-cert\") pod \"bfe29e55-1057-4321-84e7-3e87e81edc6a\" (UID: \"bfe29e55-1057-4321-84e7-3e87e81edc6a\") " Jul 11 01:13:20.064994 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:13:20.064826 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bfe29e55-1057-4321-84e7-3e87e81edc6a-console-oauth-config\") pod \"bfe29e55-1057-4321-84e7-3e87e81edc6a\" (UID: \"bfe29e55-1057-4321-84e7-3e87e81edc6a\") " Jul 11 01:13:20.065190 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:13:20.065054 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfe29e55-1057-4321-84e7-3e87e81edc6a-service-ca" (OuterVolumeSpecName: "service-ca") pod "bfe29e55-1057-4321-84e7-3e87e81edc6a" (UID: "bfe29e55-1057-4321-84e7-3e87e81edc6a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 11 01:13:20.065256 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:13:20.065227 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfe29e55-1057-4321-84e7-3e87e81edc6a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "bfe29e55-1057-4321-84e7-3e87e81edc6a" (UID: "bfe29e55-1057-4321-84e7-3e87e81edc6a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 11 01:13:20.065352 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:13:20.065332 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfe29e55-1057-4321-84e7-3e87e81edc6a-console-config" (OuterVolumeSpecName: "console-config") pod "bfe29e55-1057-4321-84e7-3e87e81edc6a" (UID: "bfe29e55-1057-4321-84e7-3e87e81edc6a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 11 01:13:20.065352 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:13:20.065330 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfe29e55-1057-4321-84e7-3e87e81edc6a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "bfe29e55-1057-4321-84e7-3e87e81edc6a" (UID: "bfe29e55-1057-4321-84e7-3e87e81edc6a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 11 01:13:20.067085 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:13:20.067048 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfe29e55-1057-4321-84e7-3e87e81edc6a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "bfe29e55-1057-4321-84e7-3e87e81edc6a" (UID: "bfe29e55-1057-4321-84e7-3e87e81edc6a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 11 01:13:20.067201 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:13:20.067124 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfe29e55-1057-4321-84e7-3e87e81edc6a-kube-api-access-hvgnm" (OuterVolumeSpecName: "kube-api-access-hvgnm") pod "bfe29e55-1057-4321-84e7-3e87e81edc6a" (UID: "bfe29e55-1057-4321-84e7-3e87e81edc6a"). InnerVolumeSpecName "kube-api-access-hvgnm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 11 01:13:20.067201 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:13:20.067126 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfe29e55-1057-4321-84e7-3e87e81edc6a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "bfe29e55-1057-4321-84e7-3e87e81edc6a" (UID: "bfe29e55-1057-4321-84e7-3e87e81edc6a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 11 01:13:20.165607 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:13:20.165572 2572 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bfe29e55-1057-4321-84e7-3e87e81edc6a-console-oauth-config\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:13:20.165607 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:13:20.165598 2572 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bfe29e55-1057-4321-84e7-3e87e81edc6a-service-ca\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:13:20.165607 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:13:20.165608 2572 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bfe29e55-1057-4321-84e7-3e87e81edc6a-console-config\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:13:20.165607 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:13:20.165616 2572 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bfe29e55-1057-4321-84e7-3e87e81edc6a-oauth-serving-cert\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:13:20.165877 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:13:20.165624 2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfe29e55-1057-4321-84e7-3e87e81edc6a-trusted-ca-bundle\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:13:20.165877 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:13:20.165634 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hvgnm\" (UniqueName: \"kubernetes.io/projected/bfe29e55-1057-4321-84e7-3e87e81edc6a-kube-api-access-hvgnm\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:13:20.165877 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:13:20.165643 2572 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bfe29e55-1057-4321-84e7-3e87e81edc6a-console-serving-cert\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:13:20.775749 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:13:20.775712 2572 generic.go:356] "Generic (PLEG): container finished" podID="bfe29e55-1057-4321-84e7-3e87e81edc6a" containerID="f088adb4898d1e5f1bf9bc0c7077f8e747bf33ed7705dc4f18d547fd96217fa7" exitCode=0 Jul 11 01:13:20.775749 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:13:20.775752 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bc59fbd64-p95hj" Jul 11 01:13:20.776181 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:13:20.775772 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bc59fbd64-p95hj" event={"ID":"bfe29e55-1057-4321-84e7-3e87e81edc6a","Type":"ContainerDied","Data":"f088adb4898d1e5f1bf9bc0c7077f8e747bf33ed7705dc4f18d547fd96217fa7"} Jul 11 01:13:20.776181 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:13:20.775817 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bc59fbd64-p95hj" event={"ID":"bfe29e55-1057-4321-84e7-3e87e81edc6a","Type":"ContainerDied","Data":"55060bf8dcd2f6dce821d9735e40584558457acc7002f5e8d925783ba04f75ea"} Jul 11 01:13:20.776181 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:13:20.775847 2572 scope.go:117] "RemoveContainer" containerID="f088adb4898d1e5f1bf9bc0c7077f8e747bf33ed7705dc4f18d547fd96217fa7" Jul 11 01:13:20.787975 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:13:20.787953 2572 scope.go:117] "RemoveContainer" containerID="f088adb4898d1e5f1bf9bc0c7077f8e747bf33ed7705dc4f18d547fd96217fa7" Jul 11 01:13:20.788279 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:13:20.788259 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f088adb4898d1e5f1bf9bc0c7077f8e747bf33ed7705dc4f18d547fd96217fa7\": container with ID starting with f088adb4898d1e5f1bf9bc0c7077f8e747bf33ed7705dc4f18d547fd96217fa7 not found: ID does not exist" containerID="f088adb4898d1e5f1bf9bc0c7077f8e747bf33ed7705dc4f18d547fd96217fa7" Jul 11 01:13:20.788339 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:13:20.788289 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f088adb4898d1e5f1bf9bc0c7077f8e747bf33ed7705dc4f18d547fd96217fa7"} err="failed to get container status \"f088adb4898d1e5f1bf9bc0c7077f8e747bf33ed7705dc4f18d547fd96217fa7\": rpc error: code = NotFound desc = could not find container \"f088adb4898d1e5f1bf9bc0c7077f8e747bf33ed7705dc4f18d547fd96217fa7\": container with ID starting with f088adb4898d1e5f1bf9bc0c7077f8e747bf33ed7705dc4f18d547fd96217fa7 not found: ID does not exist" Jul 11 01:13:20.791675 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:13:20.791655 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5bc59fbd64-p95hj"] Jul 11 01:13:20.798507 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:13:20.798485 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5bc59fbd64-p95hj"] Jul 11 01:13:22.255627 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:13:22.255592 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bfe29e55-1057-4321-84e7-3e87e81edc6a" path="/var/lib/kubelet/pods/bfe29e55-1057-4321-84e7-3e87e81edc6a/volumes" Jul 11 01:14:15.163156 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:14:15.163121 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-567658d647-xm9lk"] Jul 11 01:14:15.163611 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:14:15.163365 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfe29e55-1057-4321-84e7-3e87e81edc6a" containerName="console" Jul 11 01:14:15.163611 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:14:15.163375 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfe29e55-1057-4321-84e7-3e87e81edc6a" containerName="console" Jul 11 01:14:15.163611 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:14:15.163420 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfe29e55-1057-4321-84e7-3e87e81edc6a" containerName="console" Jul 11 01:14:15.166215 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:14:15.166198 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-567658d647-xm9lk" Jul 11 01:14:15.177343 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:14:15.177314 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-567658d647-xm9lk"] Jul 11 01:14:15.258473 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:14:15.258432 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/25ef8bdf-99e8-4c79-ab43-20103e63f715-oauth-serving-cert\") pod \"console-567658d647-xm9lk\" (UID: \"25ef8bdf-99e8-4c79-ab43-20103e63f715\") " pod="openshift-console/console-567658d647-xm9lk" Jul 11 01:14:15.258473 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:14:15.258483 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dn99s\" (UniqueName: \"kubernetes.io/projected/25ef8bdf-99e8-4c79-ab43-20103e63f715-kube-api-access-dn99s\") pod \"console-567658d647-xm9lk\" (UID: \"25ef8bdf-99e8-4c79-ab43-20103e63f715\") " pod="openshift-console/console-567658d647-xm9lk" Jul 11 01:14:15.258743 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:14:15.258505 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/25ef8bdf-99e8-4c79-ab43-20103e63f715-console-config\") pod \"console-567658d647-xm9lk\" (UID: \"25ef8bdf-99e8-4c79-ab43-20103e63f715\") " pod="openshift-console/console-567658d647-xm9lk" Jul 11 01:14:15.258743 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:14:15.258563 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25ef8bdf-99e8-4c79-ab43-20103e63f715-trusted-ca-bundle\") pod \"console-567658d647-xm9lk\" (UID: \"25ef8bdf-99e8-4c79-ab43-20103e63f715\") " pod="openshift-console/console-567658d647-xm9lk" Jul 11 01:14:15.258743 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:14:15.258597 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/25ef8bdf-99e8-4c79-ab43-20103e63f715-service-ca\") pod \"console-567658d647-xm9lk\" (UID: \"25ef8bdf-99e8-4c79-ab43-20103e63f715\") " pod="openshift-console/console-567658d647-xm9lk" Jul 11 01:14:15.258743 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:14:15.258622 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/25ef8bdf-99e8-4c79-ab43-20103e63f715-console-oauth-config\") pod \"console-567658d647-xm9lk\" (UID: \"25ef8bdf-99e8-4c79-ab43-20103e63f715\") " pod="openshift-console/console-567658d647-xm9lk" Jul 11 01:14:15.258743 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:14:15.258652 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/25ef8bdf-99e8-4c79-ab43-20103e63f715-console-serving-cert\") pod \"console-567658d647-xm9lk\" (UID: \"25ef8bdf-99e8-4c79-ab43-20103e63f715\") " pod="openshift-console/console-567658d647-xm9lk" Jul 11 01:14:15.359671 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:14:15.359635 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dn99s\" (UniqueName: \"kubernetes.io/projected/25ef8bdf-99e8-4c79-ab43-20103e63f715-kube-api-access-dn99s\") pod \"console-567658d647-xm9lk\" (UID: \"25ef8bdf-99e8-4c79-ab43-20103e63f715\") " pod="openshift-console/console-567658d647-xm9lk" Jul 11 01:14:15.359856 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:14:15.359685 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/25ef8bdf-99e8-4c79-ab43-20103e63f715-console-config\") pod \"console-567658d647-xm9lk\" (UID: \"25ef8bdf-99e8-4c79-ab43-20103e63f715\") " pod="openshift-console/console-567658d647-xm9lk" Jul 11 01:14:15.359856 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:14:15.359726 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25ef8bdf-99e8-4c79-ab43-20103e63f715-trusted-ca-bundle\") pod \"console-567658d647-xm9lk\" (UID: \"25ef8bdf-99e8-4c79-ab43-20103e63f715\") " pod="openshift-console/console-567658d647-xm9lk" Jul 11 01:14:15.359856 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:14:15.359750 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/25ef8bdf-99e8-4c79-ab43-20103e63f715-service-ca\") pod \"console-567658d647-xm9lk\" (UID: \"25ef8bdf-99e8-4c79-ab43-20103e63f715\") " pod="openshift-console/console-567658d647-xm9lk" Jul 11 01:14:15.359856 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:14:15.359782 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/25ef8bdf-99e8-4c79-ab43-20103e63f715-console-oauth-config\") pod \"console-567658d647-xm9lk\" (UID: \"25ef8bdf-99e8-4c79-ab43-20103e63f715\") " pod="openshift-console/console-567658d647-xm9lk" Jul 11 01:14:15.359856 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:14:15.359807 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/25ef8bdf-99e8-4c79-ab43-20103e63f715-console-serving-cert\") pod \"console-567658d647-xm9lk\" (UID: \"25ef8bdf-99e8-4c79-ab43-20103e63f715\") " pod="openshift-console/console-567658d647-xm9lk" Jul 11 01:14:15.359856 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:14:15.359827 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/25ef8bdf-99e8-4c79-ab43-20103e63f715-oauth-serving-cert\") pod \"console-567658d647-xm9lk\" (UID: \"25ef8bdf-99e8-4c79-ab43-20103e63f715\") " pod="openshift-console/console-567658d647-xm9lk" Jul 11 01:14:15.360540 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:14:15.360516 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/25ef8bdf-99e8-4c79-ab43-20103e63f715-oauth-serving-cert\") pod \"console-567658d647-xm9lk\" (UID: \"25ef8bdf-99e8-4c79-ab43-20103e63f715\") " pod="openshift-console/console-567658d647-xm9lk" Jul 11 01:14:15.360671 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:14:15.360618 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/25ef8bdf-99e8-4c79-ab43-20103e63f715-console-config\") pod \"console-567658d647-xm9lk\" (UID: \"25ef8bdf-99e8-4c79-ab43-20103e63f715\") " pod="openshift-console/console-567658d647-xm9lk" Jul 11 01:14:15.360745 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:14:15.360683 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/25ef8bdf-99e8-4c79-ab43-20103e63f715-service-ca\") pod \"console-567658d647-xm9lk\" (UID: \"25ef8bdf-99e8-4c79-ab43-20103e63f715\") " pod="openshift-console/console-567658d647-xm9lk" Jul 11 01:14:15.360812 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:14:15.360791 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25ef8bdf-99e8-4c79-ab43-20103e63f715-trusted-ca-bundle\") pod \"console-567658d647-xm9lk\" (UID: \"25ef8bdf-99e8-4c79-ab43-20103e63f715\") " pod="openshift-console/console-567658d647-xm9lk" Jul 11 01:14:15.362331 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:14:15.362305 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/25ef8bdf-99e8-4c79-ab43-20103e63f715-console-oauth-config\") pod \"console-567658d647-xm9lk\" (UID: \"25ef8bdf-99e8-4c79-ab43-20103e63f715\") " pod="openshift-console/console-567658d647-xm9lk" Jul 11 01:14:15.362416 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:14:15.362362 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/25ef8bdf-99e8-4c79-ab43-20103e63f715-console-serving-cert\") pod \"console-567658d647-xm9lk\" (UID: \"25ef8bdf-99e8-4c79-ab43-20103e63f715\") " pod="openshift-console/console-567658d647-xm9lk" Jul 11 01:14:15.367262 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:14:15.367239 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dn99s\" (UniqueName: \"kubernetes.io/projected/25ef8bdf-99e8-4c79-ab43-20103e63f715-kube-api-access-dn99s\") pod \"console-567658d647-xm9lk\" (UID: \"25ef8bdf-99e8-4c79-ab43-20103e63f715\") " pod="openshift-console/console-567658d647-xm9lk" Jul 11 01:14:15.475515 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:14:15.475490 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-567658d647-xm9lk" Jul 11 01:14:15.606069 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:14:15.606046 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-567658d647-xm9lk"] Jul 11 01:14:15.608424 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:14:15.608396 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25ef8bdf_99e8_4c79_ab43_20103e63f715.slice/crio-50f5eacfe31d08fa3915a84b76dce344ed8a95b484469c795b14e18d3da34607 WatchSource:0}: Error finding container 50f5eacfe31d08fa3915a84b76dce344ed8a95b484469c795b14e18d3da34607: Status 404 returned error can't find the container with id 50f5eacfe31d08fa3915a84b76dce344ed8a95b484469c795b14e18d3da34607 Jul 11 01:14:15.962926 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:14:15.962890 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-567658d647-xm9lk" event={"ID":"25ef8bdf-99e8-4c79-ab43-20103e63f715","Type":"ContainerStarted","Data":"ee3b840be6fb65c46130333fb3a8129cad9f5542b543fabf1f8838f7c235b95a"} Jul 11 01:14:15.963103 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:14:15.962964 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-567658d647-xm9lk" event={"ID":"25ef8bdf-99e8-4c79-ab43-20103e63f715","Type":"ContainerStarted","Data":"50f5eacfe31d08fa3915a84b76dce344ed8a95b484469c795b14e18d3da34607"} Jul 11 01:14:15.978291 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:14:15.978240 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-567658d647-xm9lk" podStartSLOduration=0.978226295 podStartE2EDuration="978.226295ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:14:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:14:15.97813842 +0000 UTC m=+460.309613965" watchObservedRunningTime="2026-07-11 01:14:15.978226295 +0000 UTC m=+460.309701839" Jul 11 01:14:25.475970 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:14:25.475932 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-567658d647-xm9lk" Jul 11 01:14:25.476507 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:14:25.475998 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-567658d647-xm9lk" Jul 11 01:14:25.480759 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:14:25.480695 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-567658d647-xm9lk" Jul 11 01:14:25.999633 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:14:25.999599 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-567658d647-xm9lk" Jul 11 01:14:26.043866 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:14:26.043830 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-574645f4fb-hqqq2"] Jul 11 01:14:51.064015 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:14:51.063968 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-574645f4fb-hqqq2" podUID="674bdf43-f748-4dc3-a54a-31091c395941" containerName="console" containerID="cri-o://cb4df4c9a4b2b27c4add1dd4ad63b0d9ea85c24819cc538246a5d89a3919d543" gracePeriod=15 Jul 11 01:14:51.304926 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:14:51.304897 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-574645f4fb-hqqq2" Jul 11 01:14:51.347579 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:14:51.347497 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/674bdf43-f748-4dc3-a54a-31091c395941-console-serving-cert\") pod \"674bdf43-f748-4dc3-a54a-31091c395941\" (UID: \"674bdf43-f748-4dc3-a54a-31091c395941\") " Jul 11 01:14:51.347579 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:14:51.347554 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/674bdf43-f748-4dc3-a54a-31091c395941-trusted-ca-bundle\") pod \"674bdf43-f748-4dc3-a54a-31091c395941\" (UID: \"674bdf43-f748-4dc3-a54a-31091c395941\") " Jul 11 01:14:51.347807 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:14:51.347585 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/674bdf43-f748-4dc3-a54a-31091c395941-service-ca\") pod \"674bdf43-f748-4dc3-a54a-31091c395941\" (UID: \"674bdf43-f748-4dc3-a54a-31091c395941\") " Jul 11 01:14:51.347807 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:14:51.347614 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/674bdf43-f748-4dc3-a54a-31091c395941-console-config\") pod \"674bdf43-f748-4dc3-a54a-31091c395941\" (UID: \"674bdf43-f748-4dc3-a54a-31091c395941\") " Jul 11 01:14:51.347807 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:14:51.347642 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/674bdf43-f748-4dc3-a54a-31091c395941-console-oauth-config\") pod \"674bdf43-f748-4dc3-a54a-31091c395941\" (UID: \"674bdf43-f748-4dc3-a54a-31091c395941\") " Jul 11 01:14:51.347807 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:14:51.347668 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2hclj\" (UniqueName: \"kubernetes.io/projected/674bdf43-f748-4dc3-a54a-31091c395941-kube-api-access-2hclj\") pod \"674bdf43-f748-4dc3-a54a-31091c395941\" (UID: \"674bdf43-f748-4dc3-a54a-31091c395941\") " Jul 11 01:14:51.347807 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:14:51.347777 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/674bdf43-f748-4dc3-a54a-31091c395941-oauth-serving-cert\") pod \"674bdf43-f748-4dc3-a54a-31091c395941\" (UID: \"674bdf43-f748-4dc3-a54a-31091c395941\") " Jul 11 01:14:51.348112 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:14:51.348064 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/674bdf43-f748-4dc3-a54a-31091c395941-console-config" (OuterVolumeSpecName: "console-config") pod "674bdf43-f748-4dc3-a54a-31091c395941" (UID: "674bdf43-f748-4dc3-a54a-31091c395941"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 11 01:14:51.348112 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:14:51.348093 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/674bdf43-f748-4dc3-a54a-31091c395941-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "674bdf43-f748-4dc3-a54a-31091c395941" (UID: "674bdf43-f748-4dc3-a54a-31091c395941"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 11 01:14:51.348112 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:14:51.348092 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/674bdf43-f748-4dc3-a54a-31091c395941-service-ca" (OuterVolumeSpecName: "service-ca") pod "674bdf43-f748-4dc3-a54a-31091c395941" (UID: "674bdf43-f748-4dc3-a54a-31091c395941"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 11 01:14:51.348387 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:14:51.348297 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/674bdf43-f748-4dc3-a54a-31091c395941-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "674bdf43-f748-4dc3-a54a-31091c395941" (UID: "674bdf43-f748-4dc3-a54a-31091c395941"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 11 01:14:51.349752 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:14:51.349671 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/674bdf43-f748-4dc3-a54a-31091c395941-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "674bdf43-f748-4dc3-a54a-31091c395941" (UID: "674bdf43-f748-4dc3-a54a-31091c395941"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 11 01:14:51.349851 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:14:51.349745 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/674bdf43-f748-4dc3-a54a-31091c395941-kube-api-access-2hclj" (OuterVolumeSpecName: "kube-api-access-2hclj") pod "674bdf43-f748-4dc3-a54a-31091c395941" (UID: "674bdf43-f748-4dc3-a54a-31091c395941"). InnerVolumeSpecName "kube-api-access-2hclj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 11 01:14:51.349851 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:14:51.349800 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/674bdf43-f748-4dc3-a54a-31091c395941-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "674bdf43-f748-4dc3-a54a-31091c395941" (UID: "674bdf43-f748-4dc3-a54a-31091c395941"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 11 01:14:51.449159 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:14:51.449112 2572 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/674bdf43-f748-4dc3-a54a-31091c395941-oauth-serving-cert\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:14:51.449159 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:14:51.449154 2572 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/674bdf43-f748-4dc3-a54a-31091c395941-console-serving-cert\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:14:51.449159 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:14:51.449164 2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/674bdf43-f748-4dc3-a54a-31091c395941-trusted-ca-bundle\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:14:51.449159 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:14:51.449175 2572 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/674bdf43-f748-4dc3-a54a-31091c395941-service-ca\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:14:51.449432 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:14:51.449183 2572 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/674bdf43-f748-4dc3-a54a-31091c395941-console-config\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:14:51.449432 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:14:51.449192 2572 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/674bdf43-f748-4dc3-a54a-31091c395941-console-oauth-config\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:14:51.449432 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:14:51.449200 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2hclj\" (UniqueName: \"kubernetes.io/projected/674bdf43-f748-4dc3-a54a-31091c395941-kube-api-access-2hclj\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:14:52.082692 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:14:52.082657 2572 generic.go:356] "Generic (PLEG): container finished" podID="674bdf43-f748-4dc3-a54a-31091c395941" containerID="cb4df4c9a4b2b27c4add1dd4ad63b0d9ea85c24819cc538246a5d89a3919d543" exitCode=0 Jul 11 01:14:52.083072 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:14:52.082720 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-574645f4fb-hqqq2" Jul 11 01:14:52.083072 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:14:52.082730 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-574645f4fb-hqqq2" event={"ID":"674bdf43-f748-4dc3-a54a-31091c395941","Type":"ContainerDied","Data":"cb4df4c9a4b2b27c4add1dd4ad63b0d9ea85c24819cc538246a5d89a3919d543"} Jul 11 01:14:52.083072 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:14:52.082774 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-574645f4fb-hqqq2" event={"ID":"674bdf43-f748-4dc3-a54a-31091c395941","Type":"ContainerDied","Data":"6ebc300cf85fd1ce669f8828f75a4912b054b16468c3461ccf2c9892698f3543"} Jul 11 01:14:52.083072 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:14:52.082793 2572 scope.go:117] "RemoveContainer" containerID="cb4df4c9a4b2b27c4add1dd4ad63b0d9ea85c24819cc538246a5d89a3919d543" Jul 11 01:14:52.090737 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:14:52.090689 2572 scope.go:117] "RemoveContainer" containerID="cb4df4c9a4b2b27c4add1dd4ad63b0d9ea85c24819cc538246a5d89a3919d543" Jul 11 01:14:52.090969 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:14:52.090950 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb4df4c9a4b2b27c4add1dd4ad63b0d9ea85c24819cc538246a5d89a3919d543\": container with ID starting with cb4df4c9a4b2b27c4add1dd4ad63b0d9ea85c24819cc538246a5d89a3919d543 not found: ID does not exist" containerID="cb4df4c9a4b2b27c4add1dd4ad63b0d9ea85c24819cc538246a5d89a3919d543" Jul 11 01:14:52.091036 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:14:52.090982 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb4df4c9a4b2b27c4add1dd4ad63b0d9ea85c24819cc538246a5d89a3919d543"} err="failed to get container status \"cb4df4c9a4b2b27c4add1dd4ad63b0d9ea85c24819cc538246a5d89a3919d543\": rpc error: code = NotFound desc = could not find container \"cb4df4c9a4b2b27c4add1dd4ad63b0d9ea85c24819cc538246a5d89a3919d543\": container with ID starting with cb4df4c9a4b2b27c4add1dd4ad63b0d9ea85c24819cc538246a5d89a3919d543 not found: ID does not exist" Jul 11 01:14:52.102910 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:14:52.102886 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-574645f4fb-hqqq2"] Jul 11 01:14:52.107856 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:14:52.107832 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-574645f4fb-hqqq2"] Jul 11 01:14:52.255643 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:14:52.255612 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="674bdf43-f748-4dc3-a54a-31091c395941" path="/var/lib/kubelet/pods/674bdf43-f748-4dc3-a54a-31091c395941/volumes" Jul 11 01:15:39.490528 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:15:39.490491 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-78b66d76bd-j7g9t"] Jul 11 01:15:39.490961 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:15:39.490742 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="674bdf43-f748-4dc3-a54a-31091c395941" containerName="console" Jul 11 01:15:39.490961 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:15:39.490753 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="674bdf43-f748-4dc3-a54a-31091c395941" containerName="console" Jul 11 01:15:39.490961 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:15:39.490801 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="674bdf43-f748-4dc3-a54a-31091c395941" containerName="console" Jul 11 01:15:39.493836 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:15:39.493813 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-78b66d76bd-j7g9t" Jul 11 01:15:39.496416 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:15:39.496388 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 11 01:15:39.496551 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:15:39.496431 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 11 01:15:39.497868 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:15:39.497849 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 11 01:15:39.497974 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:15:39.497876 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 11 01:15:39.497974 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:15:39.497849 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-97678\"" Jul 11 01:15:39.497974 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:15:39.497916 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 11 01:15:39.511245 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:15:39.511221 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-78b66d76bd-j7g9t"] Jul 11 01:15:39.608159 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:15:39.608117 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/def65b05-657c-41f9-8e29-693603cf7c23-cert\") pod \"lws-controller-manager-78b66d76bd-j7g9t\" (UID: \"def65b05-657c-41f9-8e29-693603cf7c23\") " pod="openshift-lws-operator/lws-controller-manager-78b66d76bd-j7g9t" Jul 11 01:15:39.608159 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:15:39.608160 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/def65b05-657c-41f9-8e29-693603cf7c23-manager-config\") pod \"lws-controller-manager-78b66d76bd-j7g9t\" (UID: \"def65b05-657c-41f9-8e29-693603cf7c23\") " pod="openshift-lws-operator/lws-controller-manager-78b66d76bd-j7g9t" Jul 11 01:15:39.608387 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:15:39.608183 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvvjt\" (UniqueName: \"kubernetes.io/projected/def65b05-657c-41f9-8e29-693603cf7c23-kube-api-access-gvvjt\") pod \"lws-controller-manager-78b66d76bd-j7g9t\" (UID: \"def65b05-657c-41f9-8e29-693603cf7c23\") " pod="openshift-lws-operator/lws-controller-manager-78b66d76bd-j7g9t" Jul 11 01:15:39.608387 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:15:39.608254 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/def65b05-657c-41f9-8e29-693603cf7c23-metrics-cert\") pod \"lws-controller-manager-78b66d76bd-j7g9t\" (UID: \"def65b05-657c-41f9-8e29-693603cf7c23\") " pod="openshift-lws-operator/lws-controller-manager-78b66d76bd-j7g9t" Jul 11 01:15:39.709450 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:15:39.709407 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvvjt\" (UniqueName: \"kubernetes.io/projected/def65b05-657c-41f9-8e29-693603cf7c23-kube-api-access-gvvjt\") pod \"lws-controller-manager-78b66d76bd-j7g9t\" (UID: \"def65b05-657c-41f9-8e29-693603cf7c23\") " pod="openshift-lws-operator/lws-controller-manager-78b66d76bd-j7g9t" Jul 11 01:15:39.709579 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:15:39.709461 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/def65b05-657c-41f9-8e29-693603cf7c23-metrics-cert\") pod \"lws-controller-manager-78b66d76bd-j7g9t\" (UID: \"def65b05-657c-41f9-8e29-693603cf7c23\") " pod="openshift-lws-operator/lws-controller-manager-78b66d76bd-j7g9t" Jul 11 01:15:39.709579 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:15:39.709520 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/def65b05-657c-41f9-8e29-693603cf7c23-cert\") pod \"lws-controller-manager-78b66d76bd-j7g9t\" (UID: \"def65b05-657c-41f9-8e29-693603cf7c23\") " pod="openshift-lws-operator/lws-controller-manager-78b66d76bd-j7g9t" Jul 11 01:15:39.709579 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:15:39.709538 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/def65b05-657c-41f9-8e29-693603cf7c23-manager-config\") pod \"lws-controller-manager-78b66d76bd-j7g9t\" (UID: \"def65b05-657c-41f9-8e29-693603cf7c23\") " pod="openshift-lws-operator/lws-controller-manager-78b66d76bd-j7g9t" Jul 11 01:15:39.710158 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:15:39.710133 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/def65b05-657c-41f9-8e29-693603cf7c23-manager-config\") pod \"lws-controller-manager-78b66d76bd-j7g9t\" (UID: \"def65b05-657c-41f9-8e29-693603cf7c23\") " pod="openshift-lws-operator/lws-controller-manager-78b66d76bd-j7g9t" Jul 11 01:15:39.712068 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:15:39.712046 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/def65b05-657c-41f9-8e29-693603cf7c23-cert\") pod \"lws-controller-manager-78b66d76bd-j7g9t\" (UID: \"def65b05-657c-41f9-8e29-693603cf7c23\") " pod="openshift-lws-operator/lws-controller-manager-78b66d76bd-j7g9t" Jul 11 01:15:39.712146 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:15:39.712098 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/def65b05-657c-41f9-8e29-693603cf7c23-metrics-cert\") pod \"lws-controller-manager-78b66d76bd-j7g9t\" (UID: \"def65b05-657c-41f9-8e29-693603cf7c23\") " pod="openshift-lws-operator/lws-controller-manager-78b66d76bd-j7g9t" Jul 11 01:15:39.725361 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:15:39.725333 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvvjt\" (UniqueName: \"kubernetes.io/projected/def65b05-657c-41f9-8e29-693603cf7c23-kube-api-access-gvvjt\") pod \"lws-controller-manager-78b66d76bd-j7g9t\" (UID: \"def65b05-657c-41f9-8e29-693603cf7c23\") " pod="openshift-lws-operator/lws-controller-manager-78b66d76bd-j7g9t" Jul 11 01:15:39.803163 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:15:39.803060 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-78b66d76bd-j7g9t" Jul 11 01:15:39.925609 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:15:39.925498 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-78b66d76bd-j7g9t"] Jul 11 01:15:39.928127 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:15:39.928100 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddef65b05_657c_41f9_8e29_693603cf7c23.slice/crio-bcf3511008766c02c4b8499f5037d878b48e545660848e93770f0eb5aab87d4f WatchSource:0}: Error finding container bcf3511008766c02c4b8499f5037d878b48e545660848e93770f0eb5aab87d4f: Status 404 returned error can't find the container with id bcf3511008766c02c4b8499f5037d878b48e545660848e93770f0eb5aab87d4f Jul 11 01:15:40.242170 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:15:40.242140 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-78b66d76bd-j7g9t" event={"ID":"def65b05-657c-41f9-8e29-693603cf7c23","Type":"ContainerStarted","Data":"bcf3511008766c02c4b8499f5037d878b48e545660848e93770f0eb5aab87d4f"} Jul 11 01:15:43.254297 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:15:43.254257 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-78b66d76bd-j7g9t" event={"ID":"def65b05-657c-41f9-8e29-693603cf7c23","Type":"ContainerStarted","Data":"130cc4a8b83ded90f6564465e3fca2e8ccda42a01bf6e1b2a590670214155935"} Jul 11 01:15:43.254694 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:15:43.254396 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-78b66d76bd-j7g9t" Jul 11 01:15:43.269547 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:15:43.269495 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-78b66d76bd-j7g9t" podStartSLOduration=1.915394987 podStartE2EDuration="4.269478771s" totalImagesPullingTime="2.354083784s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:15:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:15:43.269004581 +0000 UTC m=+547.600480150" watchObservedRunningTime="2026-07-11 01:15:43.269478771 +0000 UTC m=+547.600954314" Jul 11 01:15:49.017603 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:15:49.017568 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68fcd49758-w5rpp"] Jul 11 01:15:49.020899 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:15:49.020883 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-68fcd49758-w5rpp" Jul 11 01:15:49.023351 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:15:49.023327 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-ppx5t\"" Jul 11 01:15:49.023351 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:15:49.023337 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 11 01:15:49.023534 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:15:49.023329 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 11 01:15:49.023615 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:15:49.023602 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 11 01:15:49.023727 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:15:49.023709 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 11 01:15:49.031028 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:15:49.031006 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68fcd49758-w5rpp"] Jul 11 01:15:49.180045 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:15:49.180006 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2b129304-ec54-472f-b487-057697e5f39a-webhook-cert\") pod \"opendatahub-operator-controller-manager-68fcd49758-w5rpp\" (UID: \"2b129304-ec54-472f-b487-057697e5f39a\") " pod="opendatahub/opendatahub-operator-controller-manager-68fcd49758-w5rpp" Jul 11 01:15:49.180045 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:15:49.180055 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b129304-ec54-472f-b487-057697e5f39a-tmp\") pod \"opendatahub-operator-controller-manager-68fcd49758-w5rpp\" (UID: \"2b129304-ec54-472f-b487-057697e5f39a\") " pod="opendatahub/opendatahub-operator-controller-manager-68fcd49758-w5rpp" Jul 11 01:15:49.180261 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:15:49.180081 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2b129304-ec54-472f-b487-057697e5f39a-manifests\") pod \"opendatahub-operator-controller-manager-68fcd49758-w5rpp\" (UID: \"2b129304-ec54-472f-b487-057697e5f39a\") " pod="opendatahub/opendatahub-operator-controller-manager-68fcd49758-w5rpp" Jul 11 01:15:49.180261 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:15:49.180132 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttnh7\" (UniqueName: \"kubernetes.io/projected/2b129304-ec54-472f-b487-057697e5f39a-kube-api-access-ttnh7\") pod \"opendatahub-operator-controller-manager-68fcd49758-w5rpp\" (UID: \"2b129304-ec54-472f-b487-057697e5f39a\") " pod="opendatahub/opendatahub-operator-controller-manager-68fcd49758-w5rpp" Jul 11 01:15:49.180261 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:15:49.180151 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2b129304-ec54-472f-b487-057697e5f39a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68fcd49758-w5rpp\" (UID: \"2b129304-ec54-472f-b487-057697e5f39a\") " pod="opendatahub/opendatahub-operator-controller-manager-68fcd49758-w5rpp" Jul 11 01:15:49.280607 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:15:49.280524 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2b129304-ec54-472f-b487-057697e5f39a-webhook-cert\") pod \"opendatahub-operator-controller-manager-68fcd49758-w5rpp\" (UID: \"2b129304-ec54-472f-b487-057697e5f39a\") " pod="opendatahub/opendatahub-operator-controller-manager-68fcd49758-w5rpp" Jul 11 01:15:49.280607 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:15:49.280571 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b129304-ec54-472f-b487-057697e5f39a-tmp\") pod \"opendatahub-operator-controller-manager-68fcd49758-w5rpp\" (UID: \"2b129304-ec54-472f-b487-057697e5f39a\") " pod="opendatahub/opendatahub-operator-controller-manager-68fcd49758-w5rpp" Jul 11 01:15:49.280607 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:15:49.280601 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2b129304-ec54-472f-b487-057697e5f39a-manifests\") pod \"opendatahub-operator-controller-manager-68fcd49758-w5rpp\" (UID: \"2b129304-ec54-472f-b487-057697e5f39a\") " pod="opendatahub/opendatahub-operator-controller-manager-68fcd49758-w5rpp" Jul 11 01:15:49.280891 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:15:49.280623 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttnh7\" (UniqueName: \"kubernetes.io/projected/2b129304-ec54-472f-b487-057697e5f39a-kube-api-access-ttnh7\") pod \"opendatahub-operator-controller-manager-68fcd49758-w5rpp\" (UID: \"2b129304-ec54-472f-b487-057697e5f39a\") " pod="opendatahub/opendatahub-operator-controller-manager-68fcd49758-w5rpp" Jul 11 01:15:49.280891 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:15:49.280644 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2b129304-ec54-472f-b487-057697e5f39a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68fcd49758-w5rpp\" (UID: \"2b129304-ec54-472f-b487-057697e5f39a\") " pod="opendatahub/opendatahub-operator-controller-manager-68fcd49758-w5rpp" Jul 11 01:15:49.281107 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:15:49.281085 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2b129304-ec54-472f-b487-057697e5f39a-manifests\") pod \"opendatahub-operator-controller-manager-68fcd49758-w5rpp\" (UID: \"2b129304-ec54-472f-b487-057697e5f39a\") " pod="opendatahub/opendatahub-operator-controller-manager-68fcd49758-w5rpp" Jul 11 01:15:49.282851 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:15:49.282830 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b129304-ec54-472f-b487-057697e5f39a-tmp\") pod \"opendatahub-operator-controller-manager-68fcd49758-w5rpp\" (UID: \"2b129304-ec54-472f-b487-057697e5f39a\") " pod="opendatahub/opendatahub-operator-controller-manager-68fcd49758-w5rpp" Jul 11 01:15:49.282981 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:15:49.282962 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2b129304-ec54-472f-b487-057697e5f39a-webhook-cert\") pod \"opendatahub-operator-controller-manager-68fcd49758-w5rpp\" (UID: \"2b129304-ec54-472f-b487-057697e5f39a\") " pod="opendatahub/opendatahub-operator-controller-manager-68fcd49758-w5rpp" Jul 11 01:15:49.283055 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:15:49.283037 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2b129304-ec54-472f-b487-057697e5f39a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68fcd49758-w5rpp\" (UID: \"2b129304-ec54-472f-b487-057697e5f39a\") " pod="opendatahub/opendatahub-operator-controller-manager-68fcd49758-w5rpp" Jul 11 01:15:49.289136 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:15:49.289117 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttnh7\" (UniqueName: \"kubernetes.io/projected/2b129304-ec54-472f-b487-057697e5f39a-kube-api-access-ttnh7\") pod \"opendatahub-operator-controller-manager-68fcd49758-w5rpp\" (UID: \"2b129304-ec54-472f-b487-057697e5f39a\") " pod="opendatahub/opendatahub-operator-controller-manager-68fcd49758-w5rpp" Jul 11 01:15:49.331809 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:15:49.331782 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-68fcd49758-w5rpp" Jul 11 01:15:49.465545 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:15:49.465518 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68fcd49758-w5rpp"] Jul 11 01:15:49.468413 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:15:49.468383 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b129304_ec54_472f_b487_057697e5f39a.slice/crio-e28cf164b85490aa661459a7366710c21b410f4925311c6fc86bc7cd658429e0 WatchSource:0}: Error finding container e28cf164b85490aa661459a7366710c21b410f4925311c6fc86bc7cd658429e0: Status 404 returned error can't find the container with id e28cf164b85490aa661459a7366710c21b410f4925311c6fc86bc7cd658429e0 Jul 11 01:15:50.280932 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:15:50.280886 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68fcd49758-w5rpp" event={"ID":"2b129304-ec54-472f-b487-057697e5f39a","Type":"ContainerStarted","Data":"e28cf164b85490aa661459a7366710c21b410f4925311c6fc86bc7cd658429e0"} Jul 11 01:15:53.293142 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:15:53.293096 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68fcd49758-w5rpp" event={"ID":"2b129304-ec54-472f-b487-057697e5f39a","Type":"ContainerStarted","Data":"2bf20c70f61ce3477f0207cecf68e4553bdc041d6002e9338e1975b381a0afff"} Jul 11 01:15:54.260560 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:15:54.260528 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-78b66d76bd-j7g9t" Jul 11 01:15:54.299416 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:15:54.299381 2572 generic.go:356] "Generic (PLEG): container finished" podID="2b129304-ec54-472f-b487-057697e5f39a" containerID="2bf20c70f61ce3477f0207cecf68e4553bdc041d6002e9338e1975b381a0afff" exitCode=0 Jul 11 01:15:54.299802 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:15:54.299459 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68fcd49758-w5rpp" event={"ID":"2b129304-ec54-472f-b487-057697e5f39a","Type":"ContainerDied","Data":"2bf20c70f61ce3477f0207cecf68e4553bdc041d6002e9338e1975b381a0afff"} Jul 11 01:15:55.305014 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:15:55.304987 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68fcd49758-w5rpp" event={"ID":"2b129304-ec54-472f-b487-057697e5f39a","Type":"ContainerStarted","Data":"7c8a9c974340bcfa1ea14820f2d15a8f8ff1d12c4f28970027f192d32732c7cd"} Jul 11 01:15:55.305388 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:15:55.305115 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-68fcd49758-w5rpp" Jul 11 01:15:55.325043 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:15:55.324995 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-68fcd49758-w5rpp" podStartSLOduration=3.028364168 podStartE2EDuration="7.324980136s" totalImagesPullingTime="3.236723053s" totalInitContainerRuntime="1.059892915s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:15:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:15:55.323518254 +0000 UTC m=+559.654993822" watchObservedRunningTime="2026-07-11 01:15:55.324980136 +0000 UTC m=+559.656455679" Jul 11 01:16:06.311281 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:06.311252 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-68fcd49758-w5rpp" Jul 11 01:16:16.200192 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:16.200162 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4959sk"] Jul 11 01:16:16.207960 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:16.207938 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4959sk" Jul 11 01:16:16.211853 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:16.211830 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 11 01:16:16.212315 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:16.212301 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 11 01:16:16.212371 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:16.212315 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-cdc4x\"" Jul 11 01:16:16.213618 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:16.213599 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 11 01:16:16.219292 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:16.219268 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4959sk"] Jul 11 01:16:16.300803 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:16.300752 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df477daf-9329-4003-a53b-5b7ba9afb988-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4959sk\" (UID: \"df477daf-9329-4003-a53b-5b7ba9afb988\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4959sk" Jul 11 01:16:16.300998 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:16.300822 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df477daf-9329-4003-a53b-5b7ba9afb988-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4959sk\" (UID: \"df477daf-9329-4003-a53b-5b7ba9afb988\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4959sk" Jul 11 01:16:16.300998 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:16.300846 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df477daf-9329-4003-a53b-5b7ba9afb988-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4959sk\" (UID: \"df477daf-9329-4003-a53b-5b7ba9afb988\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4959sk" Jul 11 01:16:16.300998 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:16.300890 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dnfq\" (UniqueName: \"kubernetes.io/projected/df477daf-9329-4003-a53b-5b7ba9afb988-kube-api-access-7dnfq\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4959sk\" (UID: \"df477daf-9329-4003-a53b-5b7ba9afb988\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4959sk" Jul 11 01:16:16.300998 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:16.300977 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df477daf-9329-4003-a53b-5b7ba9afb988-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4959sk\" (UID: \"df477daf-9329-4003-a53b-5b7ba9afb988\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4959sk" Jul 11 01:16:16.301158 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:16.301024 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df477daf-9329-4003-a53b-5b7ba9afb988-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4959sk\" (UID: \"df477daf-9329-4003-a53b-5b7ba9afb988\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4959sk" Jul 11 01:16:16.301158 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:16.301053 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df477daf-9329-4003-a53b-5b7ba9afb988-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4959sk\" (UID: \"df477daf-9329-4003-a53b-5b7ba9afb988\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4959sk" Jul 11 01:16:16.301158 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:16.301077 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df477daf-9329-4003-a53b-5b7ba9afb988-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4959sk\" (UID: \"df477daf-9329-4003-a53b-5b7ba9afb988\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4959sk" Jul 11 01:16:16.301158 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:16.301094 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df477daf-9329-4003-a53b-5b7ba9afb988-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4959sk\" (UID: \"df477daf-9329-4003-a53b-5b7ba9afb988\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4959sk" Jul 11 01:16:16.401844 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:16.401799 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df477daf-9329-4003-a53b-5b7ba9afb988-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4959sk\" (UID: \"df477daf-9329-4003-a53b-5b7ba9afb988\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4959sk" Jul 11 01:16:16.401844 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:16.401847 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df477daf-9329-4003-a53b-5b7ba9afb988-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4959sk\" (UID: \"df477daf-9329-4003-a53b-5b7ba9afb988\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4959sk" Jul 11 01:16:16.402068 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:16.401873 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df477daf-9329-4003-a53b-5b7ba9afb988-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4959sk\" (UID: \"df477daf-9329-4003-a53b-5b7ba9afb988\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4959sk" Jul 11 01:16:16.402068 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:16.401908 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df477daf-9329-4003-a53b-5b7ba9afb988-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4959sk\" (UID: \"df477daf-9329-4003-a53b-5b7ba9afb988\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4959sk" Jul 11 01:16:16.402068 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:16.401949 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df477daf-9329-4003-a53b-5b7ba9afb988-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4959sk\" (UID: \"df477daf-9329-4003-a53b-5b7ba9afb988\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4959sk" Jul 11 01:16:16.402068 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:16.401984 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df477daf-9329-4003-a53b-5b7ba9afb988-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4959sk\" (UID: \"df477daf-9329-4003-a53b-5b7ba9afb988\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4959sk" Jul 11 01:16:16.402068 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:16.402011 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dnfq\" (UniqueName: \"kubernetes.io/projected/df477daf-9329-4003-a53b-5b7ba9afb988-kube-api-access-7dnfq\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4959sk\" (UID: \"df477daf-9329-4003-a53b-5b7ba9afb988\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4959sk" Jul 11 01:16:16.402068 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:16.402040 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df477daf-9329-4003-a53b-5b7ba9afb988-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4959sk\" (UID: \"df477daf-9329-4003-a53b-5b7ba9afb988\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4959sk" Jul 11 01:16:16.402353 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:16.402090 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df477daf-9329-4003-a53b-5b7ba9afb988-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4959sk\" (UID: \"df477daf-9329-4003-a53b-5b7ba9afb988\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4959sk" Jul 11 01:16:16.402353 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:16.402330 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df477daf-9329-4003-a53b-5b7ba9afb988-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4959sk\" (UID: \"df477daf-9329-4003-a53b-5b7ba9afb988\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4959sk" Jul 11 01:16:16.402453 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:16.402364 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df477daf-9329-4003-a53b-5b7ba9afb988-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4959sk\" (UID: \"df477daf-9329-4003-a53b-5b7ba9afb988\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4959sk" Jul 11 01:16:16.402534 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:16.402514 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df477daf-9329-4003-a53b-5b7ba9afb988-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4959sk\" (UID: \"df477daf-9329-4003-a53b-5b7ba9afb988\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4959sk" Jul 11 01:16:16.402598 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:16.402535 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df477daf-9329-4003-a53b-5b7ba9afb988-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4959sk\" (UID: \"df477daf-9329-4003-a53b-5b7ba9afb988\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4959sk" Jul 11 01:16:16.402869 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:16.402848 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df477daf-9329-4003-a53b-5b7ba9afb988-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4959sk\" (UID: \"df477daf-9329-4003-a53b-5b7ba9afb988\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4959sk" Jul 11 01:16:16.404138 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:16.404120 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df477daf-9329-4003-a53b-5b7ba9afb988-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4959sk\" (UID: \"df477daf-9329-4003-a53b-5b7ba9afb988\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4959sk" Jul 11 01:16:16.404359 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:16.404344 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df477daf-9329-4003-a53b-5b7ba9afb988-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4959sk\" (UID: \"df477daf-9329-4003-a53b-5b7ba9afb988\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4959sk" Jul 11 01:16:16.416662 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:16.416629 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df477daf-9329-4003-a53b-5b7ba9afb988-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4959sk\" (UID: \"df477daf-9329-4003-a53b-5b7ba9afb988\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4959sk" Jul 11 01:16:16.416752 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:16.416693 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dnfq\" (UniqueName: \"kubernetes.io/projected/df477daf-9329-4003-a53b-5b7ba9afb988-kube-api-access-7dnfq\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4959sk\" (UID: \"df477daf-9329-4003-a53b-5b7ba9afb988\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4959sk" Jul 11 01:16:16.517832 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:16.517757 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4959sk" Jul 11 01:16:16.646092 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:16.646065 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4959sk"] Jul 11 01:16:16.648591 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:16:16.648562 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf477daf_9329_4003_a53b_5b7ba9afb988.slice/crio-323c7a9d73537bea27da440e9f00e45c0477314a594a72b156630626e6c7dddf WatchSource:0}: Error finding container 323c7a9d73537bea27da440e9f00e45c0477314a594a72b156630626e6c7dddf: Status 404 returned error can't find the container with id 323c7a9d73537bea27da440e9f00e45c0477314a594a72b156630626e6c7dddf Jul 11 01:16:17.386296 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:17.386257 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4959sk" event={"ID":"df477daf-9329-4003-a53b-5b7ba9afb988","Type":"ContainerStarted","Data":"323c7a9d73537bea27da440e9f00e45c0477314a594a72b156630626e6c7dddf"} Jul 11 01:16:18.065722 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:18.065668 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v46fx"] Jul 11 01:16:18.067916 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:18.067897 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v46fx" Jul 11 01:16:18.071093 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:18.071069 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-2pvm4\"" Jul 11 01:16:18.071204 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:18.071069 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 11 01:16:18.071871 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:18.071851 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 11 01:16:18.071970 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:18.071850 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 11 01:16:18.083141 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:18.083120 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v46fx"] Jul 11 01:16:18.116756 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:18.116712 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c23564b-1287-4a50-bb42-04c91386672f-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-v46fx\" (UID: \"9c23564b-1287-4a50-bb42-04c91386672f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v46fx" Jul 11 01:16:18.116904 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:18.116771 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9c23564b-1287-4a50-bb42-04c91386672f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-v46fx\" (UID: \"9c23564b-1287-4a50-bb42-04c91386672f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v46fx" Jul 11 01:16:18.116904 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:18.116822 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9c23564b-1287-4a50-bb42-04c91386672f-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-v46fx\" (UID: \"9c23564b-1287-4a50-bb42-04c91386672f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v46fx" Jul 11 01:16:18.116904 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:18.116846 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9c23564b-1287-4a50-bb42-04c91386672f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-v46fx\" (UID: \"9c23564b-1287-4a50-bb42-04c91386672f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v46fx" Jul 11 01:16:18.116904 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:18.116894 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lzvf\" (UniqueName: \"kubernetes.io/projected/9c23564b-1287-4a50-bb42-04c91386672f-kube-api-access-4lzvf\") pod \"istiod-openshift-gateway-94bb8fbfd-v46fx\" (UID: \"9c23564b-1287-4a50-bb42-04c91386672f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v46fx" Jul 11 01:16:18.117081 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:18.116921 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9c23564b-1287-4a50-bb42-04c91386672f-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-v46fx\" (UID: \"9c23564b-1287-4a50-bb42-04c91386672f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v46fx" Jul 11 01:16:18.117081 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:18.116953 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c23564b-1287-4a50-bb42-04c91386672f-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-v46fx\" (UID: \"9c23564b-1287-4a50-bb42-04c91386672f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v46fx" Jul 11 01:16:18.217602 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:18.217566 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9c23564b-1287-4a50-bb42-04c91386672f-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-v46fx\" (UID: \"9c23564b-1287-4a50-bb42-04c91386672f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v46fx" Jul 11 01:16:18.217807 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:18.217618 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c23564b-1287-4a50-bb42-04c91386672f-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-v46fx\" (UID: \"9c23564b-1287-4a50-bb42-04c91386672f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v46fx" Jul 11 01:16:18.217807 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:18.217674 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c23564b-1287-4a50-bb42-04c91386672f-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-v46fx\" (UID: \"9c23564b-1287-4a50-bb42-04c91386672f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v46fx" Jul 11 01:16:18.217807 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:18.217737 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9c23564b-1287-4a50-bb42-04c91386672f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-v46fx\" (UID: \"9c23564b-1287-4a50-bb42-04c91386672f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v46fx" Jul 11 01:16:18.217956 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:18.217811 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9c23564b-1287-4a50-bb42-04c91386672f-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-v46fx\" (UID: \"9c23564b-1287-4a50-bb42-04c91386672f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v46fx" Jul 11 01:16:18.217956 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:18.217837 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9c23564b-1287-4a50-bb42-04c91386672f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-v46fx\" (UID: \"9c23564b-1287-4a50-bb42-04c91386672f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v46fx" Jul 11 01:16:18.217956 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:18.217870 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lzvf\" (UniqueName: \"kubernetes.io/projected/9c23564b-1287-4a50-bb42-04c91386672f-kube-api-access-4lzvf\") pod \"istiod-openshift-gateway-94bb8fbfd-v46fx\" (UID: \"9c23564b-1287-4a50-bb42-04c91386672f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v46fx" Jul 11 01:16:18.218661 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:18.218601 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9c23564b-1287-4a50-bb42-04c91386672f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-v46fx\" (UID: \"9c23564b-1287-4a50-bb42-04c91386672f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v46fx" Jul 11 01:16:18.220631 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:18.220593 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c23564b-1287-4a50-bb42-04c91386672f-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-v46fx\" (UID: \"9c23564b-1287-4a50-bb42-04c91386672f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v46fx" Jul 11 01:16:18.220631 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:18.220619 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9c23564b-1287-4a50-bb42-04c91386672f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-v46fx\" (UID: \"9c23564b-1287-4a50-bb42-04c91386672f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v46fx" Jul 11 01:16:18.220836 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:18.220616 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9c23564b-1287-4a50-bb42-04c91386672f-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-v46fx\" (UID: \"9c23564b-1287-4a50-bb42-04c91386672f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v46fx" Jul 11 01:16:18.220836 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:18.220670 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9c23564b-1287-4a50-bb42-04c91386672f-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-v46fx\" (UID: \"9c23564b-1287-4a50-bb42-04c91386672f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v46fx" Jul 11 01:16:18.235372 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:18.235345 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c23564b-1287-4a50-bb42-04c91386672f-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-v46fx\" (UID: \"9c23564b-1287-4a50-bb42-04c91386672f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v46fx" Jul 11 01:16:18.236085 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:18.236054 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lzvf\" (UniqueName: \"kubernetes.io/projected/9c23564b-1287-4a50-bb42-04c91386672f-kube-api-access-4lzvf\") pod \"istiod-openshift-gateway-94bb8fbfd-v46fx\" (UID: \"9c23564b-1287-4a50-bb42-04c91386672f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v46fx" Jul 11 01:16:18.379279 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:18.379196 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v46fx" Jul 11 01:16:19.341815 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:19.341770 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:16:19.342120 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:19.341871 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:16:19.342120 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:19.341910 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:16:19.437970 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:19.437942 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v46fx"] Jul 11 01:16:19.440614 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:16:19.440583 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c23564b_1287_4a50_bb42_04c91386672f.slice/crio-e628eb1e427f0c5e491563c2b33ceccf1213183ace52de9c7cc611498291ca4d WatchSource:0}: Error finding container e628eb1e427f0c5e491563c2b33ceccf1213183ace52de9c7cc611498291ca4d: Status 404 returned error can't find the container with id e628eb1e427f0c5e491563c2b33ceccf1213183ace52de9c7cc611498291ca4d Jul 11 01:16:20.399429 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:20.399389 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4959sk" event={"ID":"df477daf-9329-4003-a53b-5b7ba9afb988","Type":"ContainerStarted","Data":"83b0a141aa293098326ac36957ed19e63a9de34b3a4e723ede2bd06e723afd25"} Jul 11 01:16:20.400934 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:20.400905 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v46fx" event={"ID":"9c23564b-1287-4a50-bb42-04c91386672f","Type":"ContainerStarted","Data":"e628eb1e427f0c5e491563c2b33ceccf1213183ace52de9c7cc611498291ca4d"} Jul 11 01:16:20.417904 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:20.417667 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4959sk" podStartSLOduration=1.726609724 podStartE2EDuration="4.417648718s" totalImagesPullingTime="2.691038994s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:16:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:16:20.417529305 +0000 UTC m=+584.749004859" watchObservedRunningTime="2026-07-11 01:16:20.417648718 +0000 UTC m=+584.749124264" Jul 11 01:16:20.518412 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:20.518377 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4959sk" Jul 11 01:16:20.522659 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:20.522627 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4959sk" Jul 11 01:16:21.404217 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:21.404181 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4959sk" Jul 11 01:16:21.405175 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:21.405156 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4959sk" Jul 11 01:16:22.458293 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:22.458255 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:16:22.458505 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:22.458329 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:16:23.411791 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:23.411749 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v46fx" event={"ID":"9c23564b-1287-4a50-bb42-04c91386672f","Type":"ContainerStarted","Data":"349d358bd8e21b50b3354761f241b3cc6fc72e19ae04c1d66270ec403fe90691"} Jul 11 01:16:23.411983 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:23.411940 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v46fx" Jul 11 01:16:23.413561 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:23.413518 2572 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-v46fx container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 11 01:16:23.413645 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:23.413574 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v46fx" podUID="9c23564b-1287-4a50-bb42-04c91386672f" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 11 01:16:23.430159 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:23.430106 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v46fx" podStartSLOduration=2.414852666 podStartE2EDuration="5.430092s" totalImagesPullingTime="3.015239334s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:16:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:16:23.428922637 +0000 UTC m=+587.760398200" watchObservedRunningTime="2026-07-11 01:16:23.430092 +0000 UTC m=+587.761567543" Jul 11 01:16:24.416195 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:16:24.416169 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-v46fx" Jul 11 01:18:02.913741 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:18:02.913692 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-567658d647-xm9lk"] Jul 11 01:18:27.933723 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:18:27.933595 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-567658d647-xm9lk" podUID="25ef8bdf-99e8-4c79-ab43-20103e63f715" containerName="console" containerID="cri-o://ee3b840be6fb65c46130333fb3a8129cad9f5542b543fabf1f8838f7c235b95a" gracePeriod=15 Jul 11 01:18:28.179361 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:18:28.179329 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-567658d647-xm9lk" Jul 11 01:18:28.220227 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:18:28.220196 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dn99s\" (UniqueName: \"kubernetes.io/projected/25ef8bdf-99e8-4c79-ab43-20103e63f715-kube-api-access-dn99s\") pod \"25ef8bdf-99e8-4c79-ab43-20103e63f715\" (UID: \"25ef8bdf-99e8-4c79-ab43-20103e63f715\") " Jul 11 01:18:28.220227 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:18:28.220232 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/25ef8bdf-99e8-4c79-ab43-20103e63f715-service-ca\") pod \"25ef8bdf-99e8-4c79-ab43-20103e63f715\" (UID: \"25ef8bdf-99e8-4c79-ab43-20103e63f715\") " Jul 11 01:18:28.220463 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:18:28.220254 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25ef8bdf-99e8-4c79-ab43-20103e63f715-trusted-ca-bundle\") pod \"25ef8bdf-99e8-4c79-ab43-20103e63f715\" (UID: \"25ef8bdf-99e8-4c79-ab43-20103e63f715\") " Jul 11 01:18:28.220463 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:18:28.220285 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/25ef8bdf-99e8-4c79-ab43-20103e63f715-oauth-serving-cert\") pod \"25ef8bdf-99e8-4c79-ab43-20103e63f715\" (UID: \"25ef8bdf-99e8-4c79-ab43-20103e63f715\") " Jul 11 01:18:28.220463 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:18:28.220303 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/25ef8bdf-99e8-4c79-ab43-20103e63f715-console-config\") pod \"25ef8bdf-99e8-4c79-ab43-20103e63f715\" (UID: \"25ef8bdf-99e8-4c79-ab43-20103e63f715\") " Jul 11 01:18:28.220463 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:18:28.220327 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/25ef8bdf-99e8-4c79-ab43-20103e63f715-console-oauth-config\") pod \"25ef8bdf-99e8-4c79-ab43-20103e63f715\" (UID: \"25ef8bdf-99e8-4c79-ab43-20103e63f715\") " Jul 11 01:18:28.220463 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:18:28.220398 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/25ef8bdf-99e8-4c79-ab43-20103e63f715-console-serving-cert\") pod \"25ef8bdf-99e8-4c79-ab43-20103e63f715\" (UID: \"25ef8bdf-99e8-4c79-ab43-20103e63f715\") " Jul 11 01:18:28.220847 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:18:28.220802 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25ef8bdf-99e8-4c79-ab43-20103e63f715-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "25ef8bdf-99e8-4c79-ab43-20103e63f715" (UID: "25ef8bdf-99e8-4c79-ab43-20103e63f715"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 11 01:18:28.220847 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:18:28.220829 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25ef8bdf-99e8-4c79-ab43-20103e63f715-console-config" (OuterVolumeSpecName: "console-config") pod "25ef8bdf-99e8-4c79-ab43-20103e63f715" (UID: "25ef8bdf-99e8-4c79-ab43-20103e63f715"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 11 01:18:28.221052 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:18:28.220821 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25ef8bdf-99e8-4c79-ab43-20103e63f715-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "25ef8bdf-99e8-4c79-ab43-20103e63f715" (UID: "25ef8bdf-99e8-4c79-ab43-20103e63f715"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 11 01:18:28.221052 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:18:28.220873 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25ef8bdf-99e8-4c79-ab43-20103e63f715-service-ca" (OuterVolumeSpecName: "service-ca") pod "25ef8bdf-99e8-4c79-ab43-20103e63f715" (UID: "25ef8bdf-99e8-4c79-ab43-20103e63f715"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 11 01:18:28.222457 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:18:28.222426 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25ef8bdf-99e8-4c79-ab43-20103e63f715-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "25ef8bdf-99e8-4c79-ab43-20103e63f715" (UID: "25ef8bdf-99e8-4c79-ab43-20103e63f715"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 11 01:18:28.222457 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:18:28.222443 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25ef8bdf-99e8-4c79-ab43-20103e63f715-kube-api-access-dn99s" (OuterVolumeSpecName: "kube-api-access-dn99s") pod "25ef8bdf-99e8-4c79-ab43-20103e63f715" (UID: "25ef8bdf-99e8-4c79-ab43-20103e63f715"). InnerVolumeSpecName "kube-api-access-dn99s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 11 01:18:28.222572 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:18:28.222479 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25ef8bdf-99e8-4c79-ab43-20103e63f715-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "25ef8bdf-99e8-4c79-ab43-20103e63f715" (UID: "25ef8bdf-99e8-4c79-ab43-20103e63f715"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 11 01:18:28.321207 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:18:28.321175 2572 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/25ef8bdf-99e8-4c79-ab43-20103e63f715-console-serving-cert\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:18:28.321207 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:18:28.321201 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dn99s\" (UniqueName: \"kubernetes.io/projected/25ef8bdf-99e8-4c79-ab43-20103e63f715-kube-api-access-dn99s\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:18:28.321207 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:18:28.321211 2572 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/25ef8bdf-99e8-4c79-ab43-20103e63f715-service-ca\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:18:28.321426 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:18:28.321219 2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25ef8bdf-99e8-4c79-ab43-20103e63f715-trusted-ca-bundle\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:18:28.321426 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:18:28.321228 2572 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/25ef8bdf-99e8-4c79-ab43-20103e63f715-oauth-serving-cert\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:18:28.321426 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:18:28.321238 2572 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/25ef8bdf-99e8-4c79-ab43-20103e63f715-console-config\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:18:28.321426 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:18:28.321247 2572 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/25ef8bdf-99e8-4c79-ab43-20103e63f715-console-oauth-config\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:18:28.852446 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:18:28.852413 2572 generic.go:356] "Generic (PLEG): container finished" podID="25ef8bdf-99e8-4c79-ab43-20103e63f715" containerID="ee3b840be6fb65c46130333fb3a8129cad9f5542b543fabf1f8838f7c235b95a" exitCode=0 Jul 11 01:18:28.852613 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:18:28.852472 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-567658d647-xm9lk" event={"ID":"25ef8bdf-99e8-4c79-ab43-20103e63f715","Type":"ContainerDied","Data":"ee3b840be6fb65c46130333fb3a8129cad9f5542b543fabf1f8838f7c235b95a"} Jul 11 01:18:28.852613 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:18:28.852475 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-567658d647-xm9lk" Jul 11 01:18:28.852613 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:18:28.852513 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-567658d647-xm9lk" event={"ID":"25ef8bdf-99e8-4c79-ab43-20103e63f715","Type":"ContainerDied","Data":"50f5eacfe31d08fa3915a84b76dce344ed8a95b484469c795b14e18d3da34607"} Jul 11 01:18:28.852613 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:18:28.852533 2572 scope.go:117] "RemoveContainer" containerID="ee3b840be6fb65c46130333fb3a8129cad9f5542b543fabf1f8838f7c235b95a" Jul 11 01:18:28.860795 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:18:28.860777 2572 scope.go:117] "RemoveContainer" containerID="ee3b840be6fb65c46130333fb3a8129cad9f5542b543fabf1f8838f7c235b95a" Jul 11 01:18:28.861071 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:18:28.861049 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee3b840be6fb65c46130333fb3a8129cad9f5542b543fabf1f8838f7c235b95a\": container with ID starting with ee3b840be6fb65c46130333fb3a8129cad9f5542b543fabf1f8838f7c235b95a not found: ID does not exist" containerID="ee3b840be6fb65c46130333fb3a8129cad9f5542b543fabf1f8838f7c235b95a" Jul 11 01:18:28.861164 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:18:28.861077 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee3b840be6fb65c46130333fb3a8129cad9f5542b543fabf1f8838f7c235b95a"} err="failed to get container status \"ee3b840be6fb65c46130333fb3a8129cad9f5542b543fabf1f8838f7c235b95a\": rpc error: code = NotFound desc = could not find container \"ee3b840be6fb65c46130333fb3a8129cad9f5542b543fabf1f8838f7c235b95a\": container with ID starting with ee3b840be6fb65c46130333fb3a8129cad9f5542b543fabf1f8838f7c235b95a not found: ID does not exist" Jul 11 01:18:28.867943 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:18:28.867918 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-567658d647-xm9lk"] Jul 11 01:18:28.870826 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:18:28.870804 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-567658d647-xm9lk"] Jul 11 01:18:30.255667 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:18:30.255626 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25ef8bdf-99e8-4c79-ab43-20103e63f715" path="/var/lib/kubelet/pods/25ef8bdf-99e8-4c79-ab43-20103e63f715/volumes" Jul 11 01:18:32.919400 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:18:32.919365 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-778tv"] Jul 11 01:18:32.919886 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:18:32.919757 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25ef8bdf-99e8-4c79-ab43-20103e63f715" containerName="console" Jul 11 01:18:32.919886 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:18:32.919774 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="25ef8bdf-99e8-4c79-ab43-20103e63f715" containerName="console" Jul 11 01:18:32.919886 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:18:32.919849 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="25ef8bdf-99e8-4c79-ab43-20103e63f715" containerName="console" Jul 11 01:18:32.922671 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:18:32.922648 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-778tv" Jul 11 01:18:32.925032 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:18:32.925006 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-bhdgc\"" Jul 11 01:18:32.932618 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:18:32.932590 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-778tv"] Jul 11 01:18:32.957550 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:18:32.957510 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2599a499-058e-499f-bd0d-f33ce58e545b-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-778tv\" (UID: \"2599a499-058e-499f-bd0d-f33ce58e545b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-778tv" Jul 11 01:18:32.957550 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:18:32.957547 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2599a499-058e-499f-bd0d-f33ce58e545b-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-778tv\" (UID: \"2599a499-058e-499f-bd0d-f33ce58e545b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-778tv" Jul 11 01:18:32.957779 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:18:32.957573 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2599a499-058e-499f-bd0d-f33ce58e545b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-778tv\" (UID: \"2599a499-058e-499f-bd0d-f33ce58e545b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-778tv" Jul 11 01:18:32.957779 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:18:32.957647 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2599a499-058e-499f-bd0d-f33ce58e545b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-778tv\" (UID: \"2599a499-058e-499f-bd0d-f33ce58e545b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-778tv" Jul 11 01:18:32.957779 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:18:32.957687 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2599a499-058e-499f-bd0d-f33ce58e545b-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-778tv\" (UID: \"2599a499-058e-499f-bd0d-f33ce58e545b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-778tv" Jul 11 01:18:32.957779 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:18:32.957727 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmmbw\" (UniqueName: \"kubernetes.io/projected/2599a499-058e-499f-bd0d-f33ce58e545b-kube-api-access-bmmbw\") pod \"maas-default-gateway-openshift-default-56654dcf7-778tv\" (UID: \"2599a499-058e-499f-bd0d-f33ce58e545b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-778tv" Jul 11 01:18:32.957908 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:18:32.957778 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2599a499-058e-499f-bd0d-f33ce58e545b-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-778tv\" (UID: \"2599a499-058e-499f-bd0d-f33ce58e545b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-778tv" Jul 11 01:18:32.957908 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:18:32.957813 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2599a499-058e-499f-bd0d-f33ce58e545b-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-778tv\" (UID: \"2599a499-058e-499f-bd0d-f33ce58e545b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-778tv" Jul 11 01:18:32.957908 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:18:32.957875 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2599a499-058e-499f-bd0d-f33ce58e545b-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-778tv\" (UID: \"2599a499-058e-499f-bd0d-f33ce58e545b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-778tv" Jul 11 01:18:33.059025 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:18:33.058986 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2599a499-058e-499f-bd0d-f33ce58e545b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-778tv\" (UID: \"2599a499-058e-499f-bd0d-f33ce58e545b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-778tv" Jul 11 01:18:33.059025 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:18:33.059026 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2599a499-058e-499f-bd0d-f33ce58e545b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-778tv\" (UID: \"2599a499-058e-499f-bd0d-f33ce58e545b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-778tv" Jul 11 01:18:33.059253 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:18:33.059049 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2599a499-058e-499f-bd0d-f33ce58e545b-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-778tv\" (UID: \"2599a499-058e-499f-bd0d-f33ce58e545b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-778tv" Jul 11 01:18:33.059253 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:18:33.059074 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmmbw\" (UniqueName: \"kubernetes.io/projected/2599a499-058e-499f-bd0d-f33ce58e545b-kube-api-access-bmmbw\") pod \"maas-default-gateway-openshift-default-56654dcf7-778tv\" (UID: \"2599a499-058e-499f-bd0d-f33ce58e545b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-778tv" Jul 11 01:18:33.059253 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:18:33.059191 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2599a499-058e-499f-bd0d-f33ce58e545b-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-778tv\" (UID: \"2599a499-058e-499f-bd0d-f33ce58e545b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-778tv" Jul 11 01:18:33.059253 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:18:33.059225 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2599a499-058e-499f-bd0d-f33ce58e545b-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-778tv\" (UID: \"2599a499-058e-499f-bd0d-f33ce58e545b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-778tv" Jul 11 01:18:33.059617 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:18:33.059283 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2599a499-058e-499f-bd0d-f33ce58e545b-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-778tv\" (UID: \"2599a499-058e-499f-bd0d-f33ce58e545b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-778tv" Jul 11 01:18:33.059617 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:18:33.059322 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2599a499-058e-499f-bd0d-f33ce58e545b-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-778tv\" (UID: \"2599a499-058e-499f-bd0d-f33ce58e545b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-778tv" Jul 11 01:18:33.059617 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:18:33.059350 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2599a499-058e-499f-bd0d-f33ce58e545b-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-778tv\" (UID: \"2599a499-058e-499f-bd0d-f33ce58e545b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-778tv" Jul 11 01:18:33.059788 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:18:33.059611 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2599a499-058e-499f-bd0d-f33ce58e545b-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-778tv\" (UID: \"2599a499-058e-499f-bd0d-f33ce58e545b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-778tv" Jul 11 01:18:33.059788 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:18:33.059674 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2599a499-058e-499f-bd0d-f33ce58e545b-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-778tv\" (UID: \"2599a499-058e-499f-bd0d-f33ce58e545b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-778tv" Jul 11 01:18:33.059788 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:18:33.059736 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2599a499-058e-499f-bd0d-f33ce58e545b-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-778tv\" (UID: \"2599a499-058e-499f-bd0d-f33ce58e545b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-778tv" Jul 11 01:18:33.059891 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:18:33.059814 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2599a499-058e-499f-bd0d-f33ce58e545b-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-778tv\" (UID: \"2599a499-058e-499f-bd0d-f33ce58e545b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-778tv" Jul 11 01:18:33.059891 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:18:33.059853 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2599a499-058e-499f-bd0d-f33ce58e545b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-778tv\" (UID: \"2599a499-058e-499f-bd0d-f33ce58e545b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-778tv" Jul 11 01:18:33.061572 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:18:33.061553 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2599a499-058e-499f-bd0d-f33ce58e545b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-778tv\" (UID: \"2599a499-058e-499f-bd0d-f33ce58e545b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-778tv" Jul 11 01:18:33.061620 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:18:33.061568 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2599a499-058e-499f-bd0d-f33ce58e545b-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-778tv\" (UID: \"2599a499-058e-499f-bd0d-f33ce58e545b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-778tv" Jul 11 01:18:33.066502 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:18:33.066477 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmmbw\" (UniqueName: \"kubernetes.io/projected/2599a499-058e-499f-bd0d-f33ce58e545b-kube-api-access-bmmbw\") pod \"maas-default-gateway-openshift-default-56654dcf7-778tv\" (UID: \"2599a499-058e-499f-bd0d-f33ce58e545b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-778tv" Jul 11 01:18:33.066600 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:18:33.066506 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2599a499-058e-499f-bd0d-f33ce58e545b-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-778tv\" (UID: \"2599a499-058e-499f-bd0d-f33ce58e545b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-778tv" Jul 11 01:18:33.233431 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:18:33.233381 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-778tv" Jul 11 01:18:33.366457 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:18:33.366431 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-778tv"] Jul 11 01:18:33.368898 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:18:33.368869 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2599a499_058e_499f_bd0d_f33ce58e545b.slice/crio-892c0ea390cf691e8a30a1151cfe888cb8d81efca6a76196a52f5ec986b224ec WatchSource:0}: Error finding container 892c0ea390cf691e8a30a1151cfe888cb8d81efca6a76196a52f5ec986b224ec: Status 404 returned error can't find the container with id 892c0ea390cf691e8a30a1151cfe888cb8d81efca6a76196a52f5ec986b224ec Jul 11 01:18:33.371115 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:18:33.371080 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:18:33.371208 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:18:33.371145 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:18:33.371208 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:18:33.371173 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:18:33.873584 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:18:33.873540 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-778tv" event={"ID":"2599a499-058e-499f-bd0d-f33ce58e545b","Type":"ContainerStarted","Data":"698faaf70355fad1c2b8d08899eb0d98c48ec61f6c3d879e4a7ce3a1be1b5ff4"} Jul 11 01:18:33.873782 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:18:33.873601 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-778tv" event={"ID":"2599a499-058e-499f-bd0d-f33ce58e545b","Type":"ContainerStarted","Data":"892c0ea390cf691e8a30a1151cfe888cb8d81efca6a76196a52f5ec986b224ec"} Jul 11 01:18:33.892814 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:18:33.892764 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-778tv" podStartSLOduration=1.892749121 podStartE2EDuration="1.892749121s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:18:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:18:33.890765783 +0000 UTC m=+718.222241327" watchObservedRunningTime="2026-07-11 01:18:33.892749121 +0000 UTC m=+718.224224665" Jul 11 01:18:34.233625 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:18:34.233585 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-778tv" Jul 11 01:18:34.238306 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:18:34.238282 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-778tv" Jul 11 01:18:34.878041 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:18:34.878007 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-778tv" Jul 11 01:18:34.878873 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:18:34.878855 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-778tv" Jul 11 01:19:59.185215 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:19:59.185182 2572 generic.go:356] "Generic (PLEG): container finished" podID="2599a499-058e-499f-bd0d-f33ce58e545b" containerID="698faaf70355fad1c2b8d08899eb0d98c48ec61f6c3d879e4a7ce3a1be1b5ff4" exitCode=0 Jul 11 01:19:59.185645 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:19:59.185248 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-778tv" event={"ID":"2599a499-058e-499f-bd0d-f33ce58e545b","Type":"ContainerDied","Data":"698faaf70355fad1c2b8d08899eb0d98c48ec61f6c3d879e4a7ce3a1be1b5ff4"} Jul 11 01:19:59.185712 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:19:59.185681 2572 scope.go:117] "RemoveContainer" containerID="698faaf70355fad1c2b8d08899eb0d98c48ec61f6c3d879e4a7ce3a1be1b5ff4" Jul 11 01:19:59.186724 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:19:59.186680 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:19:59.186842 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:19:59.186776 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:19:59.186842 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:19:59.186826 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:20:00.190630 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:20:00.190595 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-778tv" event={"ID":"2599a499-058e-499f-bd0d-f33ce58e545b","Type":"ContainerStarted","Data":"b997347a635de3f1774102197b0e7889aa25d0dbf27144afc973849664ca66c0"} Jul 11 01:20:00.234171 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:20:00.234122 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-778tv" Jul 11 01:20:00.235569 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:20:00.235529 2572 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-778tv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.20:15021/healthz/ready\": dial tcp 10.134.0.20:15021: connect: connection refused" start-of-body= Jul 11 01:20:00.235741 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:20:00.235601 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-778tv" podUID="2599a499-058e-499f-bd0d-f33ce58e545b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.20:15021/healthz/ready\": dial tcp 10.134.0.20:15021: connect: connection refused" Jul 11 01:20:01.234296 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:20:01.234254 2572 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-778tv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.20:15021/healthz/ready\": dial tcp 10.134.0.20:15021: connect: connection refused" start-of-body= Jul 11 01:20:01.234819 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:20:01.234328 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-778tv" podUID="2599a499-058e-499f-bd0d-f33ce58e545b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.20:15021/healthz/ready\": dial tcp 10.134.0.20:15021: connect: connection refused" Jul 11 01:20:02.234376 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:20:02.234335 2572 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-778tv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.20:15021/healthz/ready\": dial tcp 10.134.0.20:15021: connect: connection refused" start-of-body= Jul 11 01:20:02.235041 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:20:02.235005 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-778tv" podUID="2599a499-058e-499f-bd0d-f33ce58e545b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.20:15021/healthz/ready\": dial tcp 10.134.0.20:15021: connect: connection refused" Jul 11 01:20:03.234885 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:20:03.234841 2572 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-778tv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.20:15021/healthz/ready\": dial tcp 10.134.0.20:15021: connect: connection refused" start-of-body= Jul 11 01:20:03.235395 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:20:03.234909 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-778tv" podUID="2599a499-058e-499f-bd0d-f33ce58e545b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.20:15021/healthz/ready\": dial tcp 10.134.0.20:15021: connect: connection refused" Jul 11 01:20:04.238047 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:20:04.238017 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-778tv" Jul 11 01:20:04.238529 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:20:04.238409 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-778tv" Jul 11 01:20:04.239171 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:20:04.239151 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-778tv" Jul 11 01:20:15.814217 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:20:15.814181 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nt2jv"] Jul 11 01:20:15.817813 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:20:15.817792 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nt2jv" Jul 11 01:20:15.821081 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:20:15.821055 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-zgpm8\"" Jul 11 01:20:15.821236 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:20:15.821114 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 11 01:20:15.821236 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:20:15.821129 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 11 01:20:15.821236 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:20:15.821118 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 11 01:20:15.826997 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:20:15.826977 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nt2jv"] Jul 11 01:20:15.941277 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:20:15.941244 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4e9f492-8780-4d28-abf0-934916394663-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nt2jv\" (UID: \"c4e9f492-8780-4d28-abf0-934916394663\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nt2jv" Jul 11 01:20:15.941458 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:20:15.941324 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4e9f492-8780-4d28-abf0-934916394663-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nt2jv\" (UID: \"c4e9f492-8780-4d28-abf0-934916394663\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nt2jv" Jul 11 01:20:15.941458 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:20:15.941368 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4e9f492-8780-4d28-abf0-934916394663-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nt2jv\" (UID: \"c4e9f492-8780-4d28-abf0-934916394663\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nt2jv" Jul 11 01:20:15.941458 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:20:15.941392 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgx6v\" (UniqueName: \"kubernetes.io/projected/c4e9f492-8780-4d28-abf0-934916394663-kube-api-access-bgx6v\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nt2jv\" (UID: \"c4e9f492-8780-4d28-abf0-934916394663\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nt2jv" Jul 11 01:20:15.941458 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:20:15.941451 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4e9f492-8780-4d28-abf0-934916394663-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nt2jv\" (UID: \"c4e9f492-8780-4d28-abf0-934916394663\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nt2jv" Jul 11 01:20:15.941635 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:20:15.941482 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4e9f492-8780-4d28-abf0-934916394663-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nt2jv\" (UID: \"c4e9f492-8780-4d28-abf0-934916394663\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nt2jv" Jul 11 01:20:16.042673 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:20:16.042631 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4e9f492-8780-4d28-abf0-934916394663-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nt2jv\" (UID: \"c4e9f492-8780-4d28-abf0-934916394663\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nt2jv" Jul 11 01:20:16.042673 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:20:16.042679 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4e9f492-8780-4d28-abf0-934916394663-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nt2jv\" (UID: \"c4e9f492-8780-4d28-abf0-934916394663\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nt2jv" Jul 11 01:20:16.042951 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:20:16.042728 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4e9f492-8780-4d28-abf0-934916394663-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nt2jv\" (UID: \"c4e9f492-8780-4d28-abf0-934916394663\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nt2jv" Jul 11 01:20:16.042951 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:20:16.042832 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgx6v\" (UniqueName: \"kubernetes.io/projected/c4e9f492-8780-4d28-abf0-934916394663-kube-api-access-bgx6v\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nt2jv\" (UID: \"c4e9f492-8780-4d28-abf0-934916394663\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nt2jv" Jul 11 01:20:16.042951 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:20:16.042886 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4e9f492-8780-4d28-abf0-934916394663-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nt2jv\" (UID: \"c4e9f492-8780-4d28-abf0-934916394663\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nt2jv" Jul 11 01:20:16.042951 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:20:16.042928 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4e9f492-8780-4d28-abf0-934916394663-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nt2jv\" (UID: \"c4e9f492-8780-4d28-abf0-934916394663\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nt2jv" Jul 11 01:20:16.043172 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:20:16.043111 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4e9f492-8780-4d28-abf0-934916394663-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nt2jv\" (UID: \"c4e9f492-8780-4d28-abf0-934916394663\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nt2jv" Jul 11 01:20:16.043219 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:20:16.043190 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4e9f492-8780-4d28-abf0-934916394663-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nt2jv\" (UID: \"c4e9f492-8780-4d28-abf0-934916394663\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nt2jv" Jul 11 01:20:16.043253 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:20:16.043189 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4e9f492-8780-4d28-abf0-934916394663-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nt2jv\" (UID: \"c4e9f492-8780-4d28-abf0-934916394663\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nt2jv" Jul 11 01:20:16.045192 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:20:16.045158 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4e9f492-8780-4d28-abf0-934916394663-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nt2jv\" (UID: \"c4e9f492-8780-4d28-abf0-934916394663\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nt2jv" Jul 11 01:20:16.045381 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:20:16.045361 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4e9f492-8780-4d28-abf0-934916394663-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nt2jv\" (UID: \"c4e9f492-8780-4d28-abf0-934916394663\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nt2jv" Jul 11 01:20:16.049999 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:20:16.049977 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgx6v\" (UniqueName: \"kubernetes.io/projected/c4e9f492-8780-4d28-abf0-934916394663-kube-api-access-bgx6v\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nt2jv\" (UID: \"c4e9f492-8780-4d28-abf0-934916394663\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nt2jv" Jul 11 01:20:16.130646 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:20:16.130533 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nt2jv" Jul 11 01:20:16.265855 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:20:16.265830 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nt2jv"] Jul 11 01:20:16.268389 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:20:16.268360 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4e9f492_8780_4d28_abf0_934916394663.slice/crio-302130b56f06507d20f3a1e9bb0d706081be659974be2dac1f1b88e241e05170 WatchSource:0}: Error finding container 302130b56f06507d20f3a1e9bb0d706081be659974be2dac1f1b88e241e05170: Status 404 returned error can't find the container with id 302130b56f06507d20f3a1e9bb0d706081be659974be2dac1f1b88e241e05170 Jul 11 01:20:16.269643 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:20:16.269623 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 11 01:20:17.254774 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:20:17.254730 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nt2jv" event={"ID":"c4e9f492-8780-4d28-abf0-934916394663","Type":"ContainerStarted","Data":"302130b56f06507d20f3a1e9bb0d706081be659974be2dac1f1b88e241e05170"} Jul 11 01:20:18.259455 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:20:18.259416 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nt2jv" event={"ID":"c4e9f492-8780-4d28-abf0-934916394663","Type":"ContainerStarted","Data":"1a0e105eed4747c880c6676f1b105958a574aafb93404fd01dbf8a4e4a605b49"} Jul 11 01:20:18.276475 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:20:18.276400 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nt2jv" podStartSLOduration=2.198116404 podStartE2EDuration="3.276379263s" totalImagesPullingTime="1.078262859s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:20:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:20:18.275433687 +0000 UTC m=+822.606909258" watchObservedRunningTime="2026-07-11 01:20:18.276379263 +0000 UTC m=+822.607854808" Jul 11 01:20:26.131128 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:20:26.131087 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nt2jv" Jul 11 01:20:26.131614 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:20:26.131155 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nt2jv" Jul 11 01:20:26.143862 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:20:26.143835 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nt2jv" Jul 11 01:20:26.301520 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:20:26.301481 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nt2jv" Jul 11 01:21:06.308344 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:21:06.308305 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-c6fjm"] Jul 11 01:21:06.310988 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:21:06.310963 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c6fjm" Jul 11 01:21:06.313364 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:21:06.313344 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 11 01:21:06.325948 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:21:06.325920 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-c6fjm"] Jul 11 01:21:06.377492 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:21:06.377457 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9bfd7548-d524-404b-bed0-ac836e946495-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-c6fjm\" (UID: \"9bfd7548-d524-404b-bed0-ac836e946495\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c6fjm" Jul 11 01:21:06.377732 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:21:06.377531 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9bfd7548-d524-404b-bed0-ac836e946495-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-c6fjm\" (UID: \"9bfd7548-d524-404b-bed0-ac836e946495\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c6fjm" Jul 11 01:21:06.377732 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:21:06.377564 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9bfd7548-d524-404b-bed0-ac836e946495-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-c6fjm\" (UID: \"9bfd7548-d524-404b-bed0-ac836e946495\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c6fjm" Jul 11 01:21:06.377732 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:21:06.377596 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9bfd7548-d524-404b-bed0-ac836e946495-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-c6fjm\" (UID: \"9bfd7548-d524-404b-bed0-ac836e946495\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c6fjm" Jul 11 01:21:06.377732 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:21:06.377618 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7q2pm\" (UniqueName: \"kubernetes.io/projected/9bfd7548-d524-404b-bed0-ac836e946495-kube-api-access-7q2pm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-c6fjm\" (UID: \"9bfd7548-d524-404b-bed0-ac836e946495\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c6fjm" Jul 11 01:21:06.377962 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:21:06.377773 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9bfd7548-d524-404b-bed0-ac836e946495-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-c6fjm\" (UID: \"9bfd7548-d524-404b-bed0-ac836e946495\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c6fjm" Jul 11 01:21:06.478679 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:21:06.478628 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9bfd7548-d524-404b-bed0-ac836e946495-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-c6fjm\" (UID: \"9bfd7548-d524-404b-bed0-ac836e946495\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c6fjm" Jul 11 01:21:06.478679 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:21:06.478676 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9bfd7548-d524-404b-bed0-ac836e946495-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-c6fjm\" (UID: \"9bfd7548-d524-404b-bed0-ac836e946495\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c6fjm" Jul 11 01:21:06.478942 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:21:06.478713 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9bfd7548-d524-404b-bed0-ac836e946495-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-c6fjm\" (UID: \"9bfd7548-d524-404b-bed0-ac836e946495\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c6fjm" Jul 11 01:21:06.478942 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:21:06.478733 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9bfd7548-d524-404b-bed0-ac836e946495-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-c6fjm\" (UID: \"9bfd7548-d524-404b-bed0-ac836e946495\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c6fjm" Jul 11 01:21:06.478942 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:21:06.478752 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7q2pm\" (UniqueName: \"kubernetes.io/projected/9bfd7548-d524-404b-bed0-ac836e946495-kube-api-access-7q2pm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-c6fjm\" (UID: \"9bfd7548-d524-404b-bed0-ac836e946495\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c6fjm" Jul 11 01:21:06.479121 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:21:06.478954 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9bfd7548-d524-404b-bed0-ac836e946495-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-c6fjm\" (UID: \"9bfd7548-d524-404b-bed0-ac836e946495\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c6fjm" Jul 11 01:21:06.479241 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:21:06.479213 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9bfd7548-d524-404b-bed0-ac836e946495-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-c6fjm\" (UID: \"9bfd7548-d524-404b-bed0-ac836e946495\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c6fjm" Jul 11 01:21:06.479303 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:21:06.479243 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9bfd7548-d524-404b-bed0-ac836e946495-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-c6fjm\" (UID: \"9bfd7548-d524-404b-bed0-ac836e946495\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c6fjm" Jul 11 01:21:06.479355 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:21:06.479339 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9bfd7548-d524-404b-bed0-ac836e946495-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-c6fjm\" (UID: \"9bfd7548-d524-404b-bed0-ac836e946495\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c6fjm" Jul 11 01:21:06.481732 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:21:06.481681 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9bfd7548-d524-404b-bed0-ac836e946495-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-c6fjm\" (UID: \"9bfd7548-d524-404b-bed0-ac836e946495\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c6fjm" Jul 11 01:21:06.482746 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:21:06.482690 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9bfd7548-d524-404b-bed0-ac836e946495-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-c6fjm\" (UID: \"9bfd7548-d524-404b-bed0-ac836e946495\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c6fjm" Jul 11 01:21:06.486689 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:21:06.486642 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7q2pm\" (UniqueName: \"kubernetes.io/projected/9bfd7548-d524-404b-bed0-ac836e946495-kube-api-access-7q2pm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-c6fjm\" (UID: \"9bfd7548-d524-404b-bed0-ac836e946495\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c6fjm" Jul 11 01:21:06.621663 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:21:06.621569 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c6fjm" Jul 11 01:21:06.754017 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:21:06.753982 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-c6fjm"] Jul 11 01:21:06.757345 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:21:06.757318 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bfd7548_d524_404b_bed0_ac836e946495.slice/crio-2d263ca3b4f2150edcf49c0150b76e0f8ef36383134a12572cc2a7d1ea1c2721 WatchSource:0}: Error finding container 2d263ca3b4f2150edcf49c0150b76e0f8ef36383134a12572cc2a7d1ea1c2721: Status 404 returned error can't find the container with id 2d263ca3b4f2150edcf49c0150b76e0f8ef36383134a12572cc2a7d1ea1c2721 Jul 11 01:21:07.453410 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:21:07.453367 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c6fjm" event={"ID":"9bfd7548-d524-404b-bed0-ac836e946495","Type":"ContainerStarted","Data":"14514d4eb2f51d1e1d437a5caaf252944bebb4b8a106fee724a1af5f00d87e62"} Jul 11 01:21:07.453410 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:21:07.453417 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c6fjm" event={"ID":"9bfd7548-d524-404b-bed0-ac836e946495","Type":"ContainerStarted","Data":"2d263ca3b4f2150edcf49c0150b76e0f8ef36383134a12572cc2a7d1ea1c2721"} Jul 11 01:21:07.470756 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:21:07.470691 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c6fjm" podStartSLOduration=1.29790886 podStartE2EDuration="1.470675515s" totalImagesPullingTime="172.766655ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:21:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:21:07.469375258 +0000 UTC m=+871.800850839" watchObservedRunningTime="2026-07-11 01:21:07.470675515 +0000 UTC m=+871.802151037" Jul 11 01:21:16.622651 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:21:16.622613 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c6fjm" Jul 11 01:21:16.623172 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:21:16.622806 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c6fjm" Jul 11 01:21:16.635427 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:21:16.635396 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c6fjm" Jul 11 01:21:17.507614 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:21:17.507581 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c6fjm" Jul 11 01:36:02.573027 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:36:02.572994 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p"] Jul 11 01:36:02.576308 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:36:02.576292 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p" Jul 11 01:36:02.579069 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:36:02.579041 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-d0a13ce5-openshift-default-dockercfg-mpmpv\"" Jul 11 01:36:02.596864 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:36:02.596834 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p"] Jul 11 01:36:02.743261 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:36:02.743209 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62f7c56b-3e2c-4caf-8626-43bfa5183731-istio-data\") pod \"e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p\" (UID: \"62f7c56b-3e2c-4caf-8626-43bfa5183731\") " pod="openshift-ingress/e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p" Jul 11 01:36:02.743261 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:36:02.743274 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62f7c56b-3e2c-4caf-8626-43bfa5183731-credential-socket\") pod \"e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p\" (UID: \"62f7c56b-3e2c-4caf-8626-43bfa5183731\") " pod="openshift-ingress/e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p" Jul 11 01:36:02.743484 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:36:02.743294 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62f7c56b-3e2c-4caf-8626-43bfa5183731-istio-podinfo\") pod \"e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p\" (UID: \"62f7c56b-3e2c-4caf-8626-43bfa5183731\") " pod="openshift-ingress/e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p" Jul 11 01:36:02.743484 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:36:02.743333 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78jtg\" (UniqueName: \"kubernetes.io/projected/62f7c56b-3e2c-4caf-8626-43bfa5183731-kube-api-access-78jtg\") pod \"e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p\" (UID: \"62f7c56b-3e2c-4caf-8626-43bfa5183731\") " pod="openshift-ingress/e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p" Jul 11 01:36:02.743484 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:36:02.743353 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62f7c56b-3e2c-4caf-8626-43bfa5183731-istio-envoy\") pod \"e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p\" (UID: \"62f7c56b-3e2c-4caf-8626-43bfa5183731\") " pod="openshift-ingress/e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p" Jul 11 01:36:02.743484 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:36:02.743431 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62f7c56b-3e2c-4caf-8626-43bfa5183731-workload-certs\") pod \"e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p\" (UID: \"62f7c56b-3e2c-4caf-8626-43bfa5183731\") " pod="openshift-ingress/e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p" Jul 11 01:36:02.743484 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:36:02.743467 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62f7c56b-3e2c-4caf-8626-43bfa5183731-istio-token\") pod \"e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p\" (UID: \"62f7c56b-3e2c-4caf-8626-43bfa5183731\") " pod="openshift-ingress/e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p" Jul 11 01:36:02.743484 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:36:02.743486 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62f7c56b-3e2c-4caf-8626-43bfa5183731-istiod-ca-cert\") pod \"e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p\" (UID: \"62f7c56b-3e2c-4caf-8626-43bfa5183731\") " pod="openshift-ingress/e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p" Jul 11 01:36:02.743772 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:36:02.743579 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62f7c56b-3e2c-4caf-8626-43bfa5183731-workload-socket\") pod \"e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p\" (UID: \"62f7c56b-3e2c-4caf-8626-43bfa5183731\") " pod="openshift-ingress/e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p" Jul 11 01:36:02.844574 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:36:02.844483 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62f7c56b-3e2c-4caf-8626-43bfa5183731-credential-socket\") pod \"e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p\" (UID: \"62f7c56b-3e2c-4caf-8626-43bfa5183731\") " pod="openshift-ingress/e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p" Jul 11 01:36:02.844574 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:36:02.844518 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62f7c56b-3e2c-4caf-8626-43bfa5183731-istio-podinfo\") pod \"e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p\" (UID: \"62f7c56b-3e2c-4caf-8626-43bfa5183731\") " pod="openshift-ingress/e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p" Jul 11 01:36:02.844574 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:36:02.844546 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78jtg\" (UniqueName: \"kubernetes.io/projected/62f7c56b-3e2c-4caf-8626-43bfa5183731-kube-api-access-78jtg\") pod \"e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p\" (UID: \"62f7c56b-3e2c-4caf-8626-43bfa5183731\") " pod="openshift-ingress/e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p" Jul 11 01:36:02.844891 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:36:02.844651 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62f7c56b-3e2c-4caf-8626-43bfa5183731-istio-envoy\") pod \"e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p\" (UID: \"62f7c56b-3e2c-4caf-8626-43bfa5183731\") " pod="openshift-ingress/e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p" Jul 11 01:36:02.844891 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:36:02.844723 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62f7c56b-3e2c-4caf-8626-43bfa5183731-workload-certs\") pod \"e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p\" (UID: \"62f7c56b-3e2c-4caf-8626-43bfa5183731\") " pod="openshift-ingress/e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p" Jul 11 01:36:02.844891 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:36:02.844770 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62f7c56b-3e2c-4caf-8626-43bfa5183731-istio-token\") pod \"e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p\" (UID: \"62f7c56b-3e2c-4caf-8626-43bfa5183731\") " pod="openshift-ingress/e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p" Jul 11 01:36:02.844891 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:36:02.844791 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62f7c56b-3e2c-4caf-8626-43bfa5183731-istiod-ca-cert\") pod \"e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p\" (UID: \"62f7c56b-3e2c-4caf-8626-43bfa5183731\") " pod="openshift-ingress/e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p" Jul 11 01:36:02.844891 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:36:02.844814 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62f7c56b-3e2c-4caf-8626-43bfa5183731-workload-socket\") pod \"e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p\" (UID: \"62f7c56b-3e2c-4caf-8626-43bfa5183731\") " pod="openshift-ingress/e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p" Jul 11 01:36:02.844891 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:36:02.844855 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62f7c56b-3e2c-4caf-8626-43bfa5183731-istio-data\") pod \"e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p\" (UID: \"62f7c56b-3e2c-4caf-8626-43bfa5183731\") " pod="openshift-ingress/e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p" Jul 11 01:36:02.845191 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:36:02.845000 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62f7c56b-3e2c-4caf-8626-43bfa5183731-credential-socket\") pod \"e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p\" (UID: \"62f7c56b-3e2c-4caf-8626-43bfa5183731\") " pod="openshift-ingress/e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p" Jul 11 01:36:02.845191 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:36:02.845171 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62f7c56b-3e2c-4caf-8626-43bfa5183731-istio-data\") pod \"e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p\" (UID: \"62f7c56b-3e2c-4caf-8626-43bfa5183731\") " pod="openshift-ingress/e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p" Jul 11 01:36:02.845298 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:36:02.845245 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62f7c56b-3e2c-4caf-8626-43bfa5183731-workload-socket\") pod \"e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p\" (UID: \"62f7c56b-3e2c-4caf-8626-43bfa5183731\") " pod="openshift-ingress/e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p" Jul 11 01:36:02.845357 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:36:02.845342 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62f7c56b-3e2c-4caf-8626-43bfa5183731-workload-certs\") pod \"e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p\" (UID: \"62f7c56b-3e2c-4caf-8626-43bfa5183731\") " pod="openshift-ingress/e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p" Jul 11 01:36:02.845516 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:36:02.845495 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62f7c56b-3e2c-4caf-8626-43bfa5183731-istiod-ca-cert\") pod \"e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p\" (UID: \"62f7c56b-3e2c-4caf-8626-43bfa5183731\") " pod="openshift-ingress/e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p" Jul 11 01:36:02.847013 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:36:02.846989 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62f7c56b-3e2c-4caf-8626-43bfa5183731-istio-envoy\") pod \"e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p\" (UID: \"62f7c56b-3e2c-4caf-8626-43bfa5183731\") " pod="openshift-ingress/e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p" Jul 11 01:36:02.847255 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:36:02.847238 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62f7c56b-3e2c-4caf-8626-43bfa5183731-istio-podinfo\") pod \"e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p\" (UID: \"62f7c56b-3e2c-4caf-8626-43bfa5183731\") " pod="openshift-ingress/e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p" Jul 11 01:36:02.852199 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:36:02.852178 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62f7c56b-3e2c-4caf-8626-43bfa5183731-istio-token\") pod \"e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p\" (UID: \"62f7c56b-3e2c-4caf-8626-43bfa5183731\") " pod="openshift-ingress/e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p" Jul 11 01:36:02.852282 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:36:02.852238 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-78jtg\" (UniqueName: \"kubernetes.io/projected/62f7c56b-3e2c-4caf-8626-43bfa5183731-kube-api-access-78jtg\") pod \"e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p\" (UID: \"62f7c56b-3e2c-4caf-8626-43bfa5183731\") " pod="openshift-ingress/e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p" Jul 11 01:36:02.889215 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:36:02.889177 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p" Jul 11 01:36:03.019829 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:36:03.019803 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p"] Jul 11 01:36:03.022231 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:36:03.022201 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62f7c56b_3e2c_4caf_8626_43bfa5183731.slice/crio-bfb1bcf793f9e72f1f459985a9b4cd74f7b1ea97b8f0f4418c4437fbcdddd97e WatchSource:0}: Error finding container bfb1bcf793f9e72f1f459985a9b4cd74f7b1ea97b8f0f4418c4437fbcdddd97e: Status 404 returned error can't find the container with id bfb1bcf793f9e72f1f459985a9b4cd74f7b1ea97b8f0f4418c4437fbcdddd97e Jul 11 01:36:03.025641 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:36:03.024939 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:36:03.025641 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:36:03.025023 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:36:03.025641 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:36:03.025063 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:36:03.030831 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:36:03.030803 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p" event={"ID":"62f7c56b-3e2c-4caf-8626-43bfa5183731","Type":"ContainerStarted","Data":"bfb1bcf793f9e72f1f459985a9b4cd74f7b1ea97b8f0f4418c4437fbcdddd97e"} Jul 11 01:36:04.037342 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:36:04.037305 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p" event={"ID":"62f7c56b-3e2c-4caf-8626-43bfa5183731","Type":"ContainerStarted","Data":"53a6a133db7fb7a7a8472e6940f02499117c58e3fc6ef95ce91f23c998cac0c5"} Jul 11 01:36:04.889790 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:36:04.889749 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p" Jul 11 01:36:04.894431 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:36:04.894403 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p" Jul 11 01:36:04.915971 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:36:04.915918 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p" podStartSLOduration=2.915901877 podStartE2EDuration="2.915901877s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:36:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:36:04.057715898 +0000 UTC m=+1768.389191466" watchObservedRunningTime="2026-07-11 01:36:04.915901877 +0000 UTC m=+1769.247377420" Jul 11 01:36:05.041656 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:36:05.041623 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p" Jul 11 01:36:05.042573 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:36:05.042553 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p" Jul 11 01:36:18.097886 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:36:18.097794 2572 generic.go:356] "Generic (PLEG): container finished" podID="62f7c56b-3e2c-4caf-8626-43bfa5183731" containerID="53a6a133db7fb7a7a8472e6940f02499117c58e3fc6ef95ce91f23c998cac0c5" exitCode=0 Jul 11 01:36:18.098373 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:36:18.097876 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p" event={"ID":"62f7c56b-3e2c-4caf-8626-43bfa5183731","Type":"ContainerDied","Data":"53a6a133db7fb7a7a8472e6940f02499117c58e3fc6ef95ce91f23c998cac0c5"} Jul 11 01:36:18.098438 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:36:18.098400 2572 scope.go:117] "RemoveContainer" containerID="53a6a133db7fb7a7a8472e6940f02499117c58e3fc6ef95ce91f23c998cac0c5" Jul 11 01:36:18.099411 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:36:18.099385 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:36:18.099471 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:36:18.099448 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:36:18.099506 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:36:18.099479 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:36:19.104376 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:36:19.104335 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p" event={"ID":"62f7c56b-3e2c-4caf-8626-43bfa5183731","Type":"ContainerStarted","Data":"563ac6e7946c6ec897fc84b6639f4a910562563157e912c6bfdfd71ac3533208"} Jul 11 01:36:19.890054 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:36:19.890011 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p" Jul 11 01:36:19.891108 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:36:19.891079 2572 patch_prober.go:28] interesting pod/e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.23:15021/healthz/ready\": dial tcp 10.134.0.23:15021: connect: connection refused" start-of-body= Jul 11 01:36:19.891239 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:36:19.891129 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p" podUID="62f7c56b-3e2c-4caf-8626-43bfa5183731" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.23:15021/healthz/ready\": dial tcp 10.134.0.23:15021: connect: connection refused" Jul 11 01:36:20.041848 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:36:20.041805 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p" Jul 11 01:36:20.890032 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:36:20.889990 2572 patch_prober.go:28] interesting pod/e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.23:15021/healthz/ready\": dial tcp 10.134.0.23:15021: connect: connection refused" start-of-body= Jul 11 01:36:20.890548 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:36:20.890058 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p" podUID="62f7c56b-3e2c-4caf-8626-43bfa5183731" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.23:15021/healthz/ready\": dial tcp 10.134.0.23:15021: connect: connection refused" Jul 11 01:36:21.889805 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:36:21.889763 2572 patch_prober.go:28] interesting pod/e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.23:15021/healthz/ready\": dial tcp 10.134.0.23:15021: connect: connection refused" start-of-body= Jul 11 01:36:21.889986 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:36:21.889822 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p" podUID="62f7c56b-3e2c-4caf-8626-43bfa5183731" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.23:15021/healthz/ready\": dial tcp 10.134.0.23:15021: connect: connection refused" Jul 11 01:36:22.904429 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:36:22.904389 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p" Jul 11 01:36:22.905430 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:36:22.905414 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p" Jul 11 01:37:34.099534 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:34.099493 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p"] Jul 11 01:37:34.100080 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:34.099746 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p" podUID="62f7c56b-3e2c-4caf-8626-43bfa5183731" containerName="istio-proxy" containerID="cri-o://563ac6e7946c6ec897fc84b6639f4a910562563157e912c6bfdfd71ac3533208" gracePeriod=30 Jul 11 01:37:34.687322 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:34.687292 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q"] Jul 11 01:37:34.690534 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:34.690514 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q" Jul 11 01:37:34.693015 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:34.692989 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-5ecad626-gw-openshift-default-dockercfg-trgff\"" Jul 11 01:37:34.703004 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:34.702981 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q"] Jul 11 01:37:34.833482 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:34.833446 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27e47a0d-065d-4421-bfe0-a6c37b9e21c5-credential-socket\") pod \"e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q\" (UID: \"27e47a0d-065d-4421-bfe0-a6c37b9e21c5\") " pod="openshift-ingress/e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q" Jul 11 01:37:34.833667 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:34.833487 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47rqk\" (UniqueName: \"kubernetes.io/projected/27e47a0d-065d-4421-bfe0-a6c37b9e21c5-kube-api-access-47rqk\") pod \"e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q\" (UID: \"27e47a0d-065d-4421-bfe0-a6c37b9e21c5\") " pod="openshift-ingress/e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q" Jul 11 01:37:34.833667 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:34.833544 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27e47a0d-065d-4421-bfe0-a6c37b9e21c5-istio-data\") pod \"e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q\" (UID: \"27e47a0d-065d-4421-bfe0-a6c37b9e21c5\") " pod="openshift-ingress/e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q" Jul 11 01:37:34.833667 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:34.833610 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27e47a0d-065d-4421-bfe0-a6c37b9e21c5-istio-envoy\") pod \"e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q\" (UID: \"27e47a0d-065d-4421-bfe0-a6c37b9e21c5\") " pod="openshift-ingress/e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q" Jul 11 01:37:34.833825 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:34.833685 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27e47a0d-065d-4421-bfe0-a6c37b9e21c5-workload-socket\") pod \"e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q\" (UID: \"27e47a0d-065d-4421-bfe0-a6c37b9e21c5\") " pod="openshift-ingress/e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q" Jul 11 01:37:34.833825 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:34.833727 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27e47a0d-065d-4421-bfe0-a6c37b9e21c5-istio-podinfo\") pod \"e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q\" (UID: \"27e47a0d-065d-4421-bfe0-a6c37b9e21c5\") " pod="openshift-ingress/e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q" Jul 11 01:37:34.833825 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:34.833772 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27e47a0d-065d-4421-bfe0-a6c37b9e21c5-workload-certs\") pod \"e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q\" (UID: \"27e47a0d-065d-4421-bfe0-a6c37b9e21c5\") " pod="openshift-ingress/e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q" Jul 11 01:37:34.833825 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:34.833815 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27e47a0d-065d-4421-bfe0-a6c37b9e21c5-istiod-ca-cert\") pod \"e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q\" (UID: \"27e47a0d-065d-4421-bfe0-a6c37b9e21c5\") " pod="openshift-ingress/e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q" Jul 11 01:37:34.833950 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:34.833860 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27e47a0d-065d-4421-bfe0-a6c37b9e21c5-istio-token\") pod \"e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q\" (UID: \"27e47a0d-065d-4421-bfe0-a6c37b9e21c5\") " pod="openshift-ingress/e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q" Jul 11 01:37:34.934927 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:34.934889 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27e47a0d-065d-4421-bfe0-a6c37b9e21c5-istio-podinfo\") pod \"e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q\" (UID: \"27e47a0d-065d-4421-bfe0-a6c37b9e21c5\") " pod="openshift-ingress/e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q" Jul 11 01:37:34.934927 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:34.934930 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27e47a0d-065d-4421-bfe0-a6c37b9e21c5-workload-certs\") pod \"e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q\" (UID: \"27e47a0d-065d-4421-bfe0-a6c37b9e21c5\") " pod="openshift-ingress/e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q" Jul 11 01:37:34.935128 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:34.934963 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27e47a0d-065d-4421-bfe0-a6c37b9e21c5-istiod-ca-cert\") pod \"e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q\" (UID: \"27e47a0d-065d-4421-bfe0-a6c37b9e21c5\") " pod="openshift-ingress/e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q" Jul 11 01:37:34.935164 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:34.935137 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27e47a0d-065d-4421-bfe0-a6c37b9e21c5-istio-token\") pod \"e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q\" (UID: \"27e47a0d-065d-4421-bfe0-a6c37b9e21c5\") " pod="openshift-ingress/e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q" Jul 11 01:37:34.935198 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:34.935189 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27e47a0d-065d-4421-bfe0-a6c37b9e21c5-credential-socket\") pod \"e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q\" (UID: \"27e47a0d-065d-4421-bfe0-a6c37b9e21c5\") " pod="openshift-ingress/e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q" Jul 11 01:37:34.935257 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:34.935212 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47rqk\" (UniqueName: \"kubernetes.io/projected/27e47a0d-065d-4421-bfe0-a6c37b9e21c5-kube-api-access-47rqk\") pod \"e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q\" (UID: \"27e47a0d-065d-4421-bfe0-a6c37b9e21c5\") " pod="openshift-ingress/e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q" Jul 11 01:37:34.935311 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:34.935272 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27e47a0d-065d-4421-bfe0-a6c37b9e21c5-istio-data\") pod \"e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q\" (UID: \"27e47a0d-065d-4421-bfe0-a6c37b9e21c5\") " pod="openshift-ingress/e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q" Jul 11 01:37:34.935311 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:34.935295 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27e47a0d-065d-4421-bfe0-a6c37b9e21c5-istio-envoy\") pod \"e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q\" (UID: \"27e47a0d-065d-4421-bfe0-a6c37b9e21c5\") " pod="openshift-ingress/e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q" Jul 11 01:37:34.935412 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:34.935325 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27e47a0d-065d-4421-bfe0-a6c37b9e21c5-workload-socket\") pod \"e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q\" (UID: \"27e47a0d-065d-4421-bfe0-a6c37b9e21c5\") " pod="openshift-ingress/e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q" Jul 11 01:37:34.935412 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:34.935350 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27e47a0d-065d-4421-bfe0-a6c37b9e21c5-workload-certs\") pod \"e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q\" (UID: \"27e47a0d-065d-4421-bfe0-a6c37b9e21c5\") " pod="openshift-ingress/e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q" Jul 11 01:37:34.935568 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:34.935546 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27e47a0d-065d-4421-bfe0-a6c37b9e21c5-credential-socket\") pod \"e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q\" (UID: \"27e47a0d-065d-4421-bfe0-a6c37b9e21c5\") " pod="openshift-ingress/e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q" Jul 11 01:37:34.935644 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:34.935616 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27e47a0d-065d-4421-bfe0-a6c37b9e21c5-istio-data\") pod \"e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q\" (UID: \"27e47a0d-065d-4421-bfe0-a6c37b9e21c5\") " pod="openshift-ingress/e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q" Jul 11 01:37:34.935819 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:34.935797 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27e47a0d-065d-4421-bfe0-a6c37b9e21c5-istiod-ca-cert\") pod \"e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q\" (UID: \"27e47a0d-065d-4421-bfe0-a6c37b9e21c5\") " pod="openshift-ingress/e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q" Jul 11 01:37:34.935893 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:34.935831 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27e47a0d-065d-4421-bfe0-a6c37b9e21c5-workload-socket\") pod \"e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q\" (UID: \"27e47a0d-065d-4421-bfe0-a6c37b9e21c5\") " pod="openshift-ingress/e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q" Jul 11 01:37:34.937512 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:34.937457 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27e47a0d-065d-4421-bfe0-a6c37b9e21c5-istio-podinfo\") pod \"e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q\" (UID: \"27e47a0d-065d-4421-bfe0-a6c37b9e21c5\") " pod="openshift-ingress/e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q" Jul 11 01:37:34.937646 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:34.937630 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27e47a0d-065d-4421-bfe0-a6c37b9e21c5-istio-envoy\") pod \"e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q\" (UID: \"27e47a0d-065d-4421-bfe0-a6c37b9e21c5\") " pod="openshift-ingress/e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q" Jul 11 01:37:34.942884 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:34.942859 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27e47a0d-065d-4421-bfe0-a6c37b9e21c5-istio-token\") pod \"e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q\" (UID: \"27e47a0d-065d-4421-bfe0-a6c37b9e21c5\") " pod="openshift-ingress/e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q" Jul 11 01:37:34.942969 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:34.942944 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-47rqk\" (UniqueName: \"kubernetes.io/projected/27e47a0d-065d-4421-bfe0-a6c37b9e21c5-kube-api-access-47rqk\") pod \"e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q\" (UID: \"27e47a0d-065d-4421-bfe0-a6c37b9e21c5\") " pod="openshift-ingress/e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q" Jul 11 01:37:35.001896 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:35.001864 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q" Jul 11 01:37:35.130970 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:35.130935 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q"] Jul 11 01:37:35.133754 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:37:35.133723 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27e47a0d_065d_4421_bfe0_a6c37b9e21c5.slice/crio-417c1a9ed95e68f0b6f86ec1dde3e1e359c13ef576b665a0ca9f468e5eeb709a WatchSource:0}: Error finding container 417c1a9ed95e68f0b6f86ec1dde3e1e359c13ef576b665a0ca9f468e5eeb709a: Status 404 returned error can't find the container with id 417c1a9ed95e68f0b6f86ec1dde3e1e359c13ef576b665a0ca9f468e5eeb709a Jul 11 01:37:35.135931 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:35.135891 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:37:35.136005 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:35.135979 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:37:35.136042 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:35.136020 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:37:35.415858 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:35.415821 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q" event={"ID":"27e47a0d-065d-4421-bfe0-a6c37b9e21c5","Type":"ContainerStarted","Data":"bd4b52e45038101e592e01b656329564cccfa21503bc1246df1cfd248e9681de"} Jul 11 01:37:35.416041 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:35.415889 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q" event={"ID":"27e47a0d-065d-4421-bfe0-a6c37b9e21c5","Type":"ContainerStarted","Data":"417c1a9ed95e68f0b6f86ec1dde3e1e359c13ef576b665a0ca9f468e5eeb709a"} Jul 11 01:37:35.435055 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:35.435010 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q" podStartSLOduration=1.43499302 podStartE2EDuration="1.43499302s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:37:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:37:35.433408319 +0000 UTC m=+1859.764883901" watchObservedRunningTime="2026-07-11 01:37:35.43499302 +0000 UTC m=+1859.766468564" Jul 11 01:37:36.003039 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:36.002999 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q" Jul 11 01:37:36.008037 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:36.008010 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q" Jul 11 01:37:36.420141 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:36.420059 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q" Jul 11 01:37:36.420863 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:36.420844 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q" Jul 11 01:37:37.906998 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:37.906962 2572 patch_prober.go:28] interesting pod/e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 11 01:37:37.907350 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:37.907046 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p" podUID="62f7c56b-3e2c-4caf-8626-43bfa5183731" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 11 01:37:39.401526 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:39.401501 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p" Jul 11 01:37:39.454042 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:39.454007 2572 generic.go:356] "Generic (PLEG): container finished" podID="62f7c56b-3e2c-4caf-8626-43bfa5183731" containerID="563ac6e7946c6ec897fc84b6639f4a910562563157e912c6bfdfd71ac3533208" exitCode=0 Jul 11 01:37:39.454361 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:39.454343 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p" event={"ID":"62f7c56b-3e2c-4caf-8626-43bfa5183731","Type":"ContainerDied","Data":"563ac6e7946c6ec897fc84b6639f4a910562563157e912c6bfdfd71ac3533208"} Jul 11 01:37:39.454512 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:39.454497 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p" event={"ID":"62f7c56b-3e2c-4caf-8626-43bfa5183731","Type":"ContainerDied","Data":"bfb1bcf793f9e72f1f459985a9b4cd74f7b1ea97b8f0f4418c4437fbcdddd97e"} Jul 11 01:37:39.454662 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:39.454649 2572 scope.go:117] "RemoveContainer" containerID="563ac6e7946c6ec897fc84b6639f4a910562563157e912c6bfdfd71ac3533208" Jul 11 01:37:39.454979 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:39.454965 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p" Jul 11 01:37:39.471713 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:39.471670 2572 scope.go:117] "RemoveContainer" containerID="53a6a133db7fb7a7a8472e6940f02499117c58e3fc6ef95ce91f23c998cac0c5" Jul 11 01:37:39.480610 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:39.480587 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62f7c56b-3e2c-4caf-8626-43bfa5183731-istio-podinfo\") pod \"62f7c56b-3e2c-4caf-8626-43bfa5183731\" (UID: \"62f7c56b-3e2c-4caf-8626-43bfa5183731\") " Jul 11 01:37:39.480737 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:39.480630 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62f7c56b-3e2c-4caf-8626-43bfa5183731-workload-certs\") pod \"62f7c56b-3e2c-4caf-8626-43bfa5183731\" (UID: \"62f7c56b-3e2c-4caf-8626-43bfa5183731\") " Jul 11 01:37:39.480737 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:39.480661 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62f7c56b-3e2c-4caf-8626-43bfa5183731-istio-token\") pod \"62f7c56b-3e2c-4caf-8626-43bfa5183731\" (UID: \"62f7c56b-3e2c-4caf-8626-43bfa5183731\") " Jul 11 01:37:39.480737 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:39.480690 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62f7c56b-3e2c-4caf-8626-43bfa5183731-credential-socket\") pod \"62f7c56b-3e2c-4caf-8626-43bfa5183731\" (UID: \"62f7c56b-3e2c-4caf-8626-43bfa5183731\") " Jul 11 01:37:39.480737 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:39.480730 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62f7c56b-3e2c-4caf-8626-43bfa5183731-workload-socket\") pod \"62f7c56b-3e2c-4caf-8626-43bfa5183731\" (UID: \"62f7c56b-3e2c-4caf-8626-43bfa5183731\") " Jul 11 01:37:39.480950 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:39.480770 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62f7c56b-3e2c-4caf-8626-43bfa5183731-istio-data\") pod \"62f7c56b-3e2c-4caf-8626-43bfa5183731\" (UID: \"62f7c56b-3e2c-4caf-8626-43bfa5183731\") " Jul 11 01:37:39.480950 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:39.480794 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62f7c56b-3e2c-4caf-8626-43bfa5183731-istio-envoy\") pod \"62f7c56b-3e2c-4caf-8626-43bfa5183731\" (UID: \"62f7c56b-3e2c-4caf-8626-43bfa5183731\") " Jul 11 01:37:39.480950 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:39.480821 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62f7c56b-3e2c-4caf-8626-43bfa5183731-istiod-ca-cert\") pod \"62f7c56b-3e2c-4caf-8626-43bfa5183731\" (UID: \"62f7c56b-3e2c-4caf-8626-43bfa5183731\") " Jul 11 01:37:39.480950 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:39.480885 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-78jtg\" (UniqueName: \"kubernetes.io/projected/62f7c56b-3e2c-4caf-8626-43bfa5183731-kube-api-access-78jtg\") pod \"62f7c56b-3e2c-4caf-8626-43bfa5183731\" (UID: \"62f7c56b-3e2c-4caf-8626-43bfa5183731\") " Jul 11 01:37:39.481738 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:39.481659 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62f7c56b-3e2c-4caf-8626-43bfa5183731-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "62f7c56b-3e2c-4caf-8626-43bfa5183731" (UID: "62f7c56b-3e2c-4caf-8626-43bfa5183731"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 01:37:39.481738 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:39.481654 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62f7c56b-3e2c-4caf-8626-43bfa5183731-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "62f7c56b-3e2c-4caf-8626-43bfa5183731" (UID: "62f7c56b-3e2c-4caf-8626-43bfa5183731"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 01:37:39.481914 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:39.481814 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62f7c56b-3e2c-4caf-8626-43bfa5183731-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "62f7c56b-3e2c-4caf-8626-43bfa5183731" (UID: "62f7c56b-3e2c-4caf-8626-43bfa5183731"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 11 01:37:39.481914 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:39.481881 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62f7c56b-3e2c-4caf-8626-43bfa5183731-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "62f7c56b-3e2c-4caf-8626-43bfa5183731" (UID: "62f7c56b-3e2c-4caf-8626-43bfa5183731"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 01:37:39.482160 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:39.482137 2572 scope.go:117] "RemoveContainer" containerID="563ac6e7946c6ec897fc84b6639f4a910562563157e912c6bfdfd71ac3533208" Jul 11 01:37:39.482406 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:39.482380 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62f7c56b-3e2c-4caf-8626-43bfa5183731-istio-data" (OuterVolumeSpecName: "istio-data") pod "62f7c56b-3e2c-4caf-8626-43bfa5183731" (UID: "62f7c56b-3e2c-4caf-8626-43bfa5183731"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 01:37:39.482609 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:37:39.482480 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"563ac6e7946c6ec897fc84b6639f4a910562563157e912c6bfdfd71ac3533208\": container with ID starting with 563ac6e7946c6ec897fc84b6639f4a910562563157e912c6bfdfd71ac3533208 not found: ID does not exist" containerID="563ac6e7946c6ec897fc84b6639f4a910562563157e912c6bfdfd71ac3533208" Jul 11 01:37:39.482609 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:39.482523 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"563ac6e7946c6ec897fc84b6639f4a910562563157e912c6bfdfd71ac3533208"} err="failed to get container status \"563ac6e7946c6ec897fc84b6639f4a910562563157e912c6bfdfd71ac3533208\": rpc error: code = NotFound desc = could not find container \"563ac6e7946c6ec897fc84b6639f4a910562563157e912c6bfdfd71ac3533208\": container with ID starting with 563ac6e7946c6ec897fc84b6639f4a910562563157e912c6bfdfd71ac3533208 not found: ID does not exist" Jul 11 01:37:39.482609 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:39.482549 2572 scope.go:117] "RemoveContainer" containerID="53a6a133db7fb7a7a8472e6940f02499117c58e3fc6ef95ce91f23c998cac0c5" Jul 11 01:37:39.483022 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:37:39.482998 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53a6a133db7fb7a7a8472e6940f02499117c58e3fc6ef95ce91f23c998cac0c5\": container with ID starting with 53a6a133db7fb7a7a8472e6940f02499117c58e3fc6ef95ce91f23c998cac0c5 not found: ID does not exist" containerID="53a6a133db7fb7a7a8472e6940f02499117c58e3fc6ef95ce91f23c998cac0c5" Jul 11 01:37:39.483087 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:39.483032 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53a6a133db7fb7a7a8472e6940f02499117c58e3fc6ef95ce91f23c998cac0c5"} err="failed to get container status \"53a6a133db7fb7a7a8472e6940f02499117c58e3fc6ef95ce91f23c998cac0c5\": rpc error: code = NotFound desc = could not find container \"53a6a133db7fb7a7a8472e6940f02499117c58e3fc6ef95ce91f23c998cac0c5\": container with ID starting with 53a6a133db7fb7a7a8472e6940f02499117c58e3fc6ef95ce91f23c998cac0c5 not found: ID does not exist" Jul 11 01:37:39.484125 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:39.484099 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/62f7c56b-3e2c-4caf-8626-43bfa5183731-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "62f7c56b-3e2c-4caf-8626-43bfa5183731" (UID: "62f7c56b-3e2c-4caf-8626-43bfa5183731"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 11 01:37:39.484125 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:39.484115 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62f7c56b-3e2c-4caf-8626-43bfa5183731-istio-token" (OuterVolumeSpecName: "istio-token") pod "62f7c56b-3e2c-4caf-8626-43bfa5183731" (UID: "62f7c56b-3e2c-4caf-8626-43bfa5183731"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 11 01:37:39.484836 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:39.484421 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62f7c56b-3e2c-4caf-8626-43bfa5183731-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "62f7c56b-3e2c-4caf-8626-43bfa5183731" (UID: "62f7c56b-3e2c-4caf-8626-43bfa5183731"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 01:37:39.484836 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:39.484505 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62f7c56b-3e2c-4caf-8626-43bfa5183731-kube-api-access-78jtg" (OuterVolumeSpecName: "kube-api-access-78jtg") pod "62f7c56b-3e2c-4caf-8626-43bfa5183731" (UID: "62f7c56b-3e2c-4caf-8626-43bfa5183731"). InnerVolumeSpecName "kube-api-access-78jtg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 11 01:37:39.582323 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:39.582286 2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62f7c56b-3e2c-4caf-8626-43bfa5183731-workload-certs\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:37:39.582323 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:39.582317 2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62f7c56b-3e2c-4caf-8626-43bfa5183731-istio-token\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:37:39.582323 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:39.582326 2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62f7c56b-3e2c-4caf-8626-43bfa5183731-credential-socket\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:37:39.582558 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:39.582336 2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62f7c56b-3e2c-4caf-8626-43bfa5183731-workload-socket\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:37:39.582558 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:39.582345 2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62f7c56b-3e2c-4caf-8626-43bfa5183731-istio-data\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:37:39.582558 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:39.582354 2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62f7c56b-3e2c-4caf-8626-43bfa5183731-istio-envoy\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:37:39.582558 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:39.582362 2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62f7c56b-3e2c-4caf-8626-43bfa5183731-istiod-ca-cert\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:37:39.582558 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:39.582369 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-78jtg\" (UniqueName: \"kubernetes.io/projected/62f7c56b-3e2c-4caf-8626-43bfa5183731-kube-api-access-78jtg\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:37:39.582558 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:39.582378 2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62f7c56b-3e2c-4caf-8626-43bfa5183731-istio-podinfo\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:37:39.778393 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:39.778355 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p"] Jul 11 01:37:39.782344 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:39.782318 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-d0a13ce5-openshift-default-58d7b6cd75-4h28p"] Jul 11 01:37:40.258424 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:40.258379 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62f7c56b-3e2c-4caf-8626-43bfa5183731" path="/var/lib/kubelet/pods/62f7c56b-3e2c-4caf-8626-43bfa5183731/volumes" Jul 11 01:37:46.485552 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:46.485517 2572 generic.go:356] "Generic (PLEG): container finished" podID="27e47a0d-065d-4421-bfe0-a6c37b9e21c5" containerID="bd4b52e45038101e592e01b656329564cccfa21503bc1246df1cfd248e9681de" exitCode=0 Jul 11 01:37:46.486060 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:46.485564 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q" event={"ID":"27e47a0d-065d-4421-bfe0-a6c37b9e21c5","Type":"ContainerDied","Data":"bd4b52e45038101e592e01b656329564cccfa21503bc1246df1cfd248e9681de"} Jul 11 01:37:46.486060 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:46.485945 2572 scope.go:117] "RemoveContainer" containerID="bd4b52e45038101e592e01b656329564cccfa21503bc1246df1cfd248e9681de" Jul 11 01:37:46.487075 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:46.487046 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:37:46.487140 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:46.487115 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:37:46.487174 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:46.487144 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:37:47.491360 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:47.491327 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q" event={"ID":"27e47a0d-065d-4421-bfe0-a6c37b9e21c5","Type":"ContainerStarted","Data":"c8160e968146a196fb91d75096e6413f2a440226047c5507de3b1b298e68b248"} Jul 11 01:37:48.002561 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:48.002516 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q" Jul 11 01:37:48.003740 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:48.003686 2572 patch_prober.go:28] interesting pod/e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused" start-of-body= Jul 11 01:37:48.003860 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:48.003765 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q" podUID="27e47a0d-065d-4421-bfe0-a6c37b9e21c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused" Jul 11 01:37:49.003304 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:49.003267 2572 patch_prober.go:28] interesting pod/e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused" start-of-body= Jul 11 01:37:49.003683 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:49.003335 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q" podUID="27e47a0d-065d-4421-bfe0-a6c37b9e21c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused" Jul 11 01:37:50.003144 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:50.003103 2572 patch_prober.go:28] interesting pod/e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused" start-of-body= Jul 11 01:37:50.003321 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:50.003164 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q" podUID="27e47a0d-065d-4421-bfe0-a6c37b9e21c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused" Jul 11 01:37:51.002369 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:51.002333 2572 patch_prober.go:28] interesting pod/e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused" start-of-body= Jul 11 01:37:51.002795 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:51.002389 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q" podUID="27e47a0d-065d-4421-bfe0-a6c37b9e21c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused" Jul 11 01:37:51.420139 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:51.420056 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q" Jul 11 01:37:52.006924 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:52.006895 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q" Jul 11 01:37:52.007911 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:37:52.007890 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q" Jul 11 01:38:40.538535 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:40.538498 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q"] Jul 11 01:38:40.538977 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:40.538737 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q" podUID="27e47a0d-065d-4421-bfe0-a6c37b9e21c5" containerName="istio-proxy" containerID="cri-o://c8160e968146a196fb91d75096e6413f2a440226047c5507de3b1b298e68b248" gracePeriod=30 Jul 11 01:38:45.730891 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:45.730849 2572 generic.go:356] "Generic (PLEG): container finished" podID="27e47a0d-065d-4421-bfe0-a6c37b9e21c5" containerID="c8160e968146a196fb91d75096e6413f2a440226047c5507de3b1b298e68b248" exitCode=0 Jul 11 01:38:45.731361 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:45.730921 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q" event={"ID":"27e47a0d-065d-4421-bfe0-a6c37b9e21c5","Type":"ContainerDied","Data":"c8160e968146a196fb91d75096e6413f2a440226047c5507de3b1b298e68b248"} Jul 11 01:38:45.731361 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:45.730993 2572 scope.go:117] "RemoveContainer" containerID="bd4b52e45038101e592e01b656329564cccfa21503bc1246df1cfd248e9681de" Jul 11 01:38:45.785731 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:45.785689 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q" Jul 11 01:38:45.857479 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:45.857450 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27e47a0d-065d-4421-bfe0-a6c37b9e21c5-workload-socket\") pod \"27e47a0d-065d-4421-bfe0-a6c37b9e21c5\" (UID: \"27e47a0d-065d-4421-bfe0-a6c37b9e21c5\") " Jul 11 01:38:45.857648 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:45.857488 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27e47a0d-065d-4421-bfe0-a6c37b9e21c5-istio-podinfo\") pod \"27e47a0d-065d-4421-bfe0-a6c37b9e21c5\" (UID: \"27e47a0d-065d-4421-bfe0-a6c37b9e21c5\") " Jul 11 01:38:45.857648 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:45.857543 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27e47a0d-065d-4421-bfe0-a6c37b9e21c5-istio-token\") pod \"27e47a0d-065d-4421-bfe0-a6c37b9e21c5\" (UID: \"27e47a0d-065d-4421-bfe0-a6c37b9e21c5\") " Jul 11 01:38:45.857648 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:45.857608 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27e47a0d-065d-4421-bfe0-a6c37b9e21c5-istio-envoy\") pod \"27e47a0d-065d-4421-bfe0-a6c37b9e21c5\" (UID: \"27e47a0d-065d-4421-bfe0-a6c37b9e21c5\") " Jul 11 01:38:45.857648 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:45.857635 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-47rqk\" (UniqueName: \"kubernetes.io/projected/27e47a0d-065d-4421-bfe0-a6c37b9e21c5-kube-api-access-47rqk\") pod \"27e47a0d-065d-4421-bfe0-a6c37b9e21c5\" (UID: \"27e47a0d-065d-4421-bfe0-a6c37b9e21c5\") " Jul 11 01:38:45.857878 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:45.857664 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27e47a0d-065d-4421-bfe0-a6c37b9e21c5-istiod-ca-cert\") pod \"27e47a0d-065d-4421-bfe0-a6c37b9e21c5\" (UID: \"27e47a0d-065d-4421-bfe0-a6c37b9e21c5\") " Jul 11 01:38:45.857878 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:45.857711 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27e47a0d-065d-4421-bfe0-a6c37b9e21c5-workload-certs\") pod \"27e47a0d-065d-4421-bfe0-a6c37b9e21c5\" (UID: \"27e47a0d-065d-4421-bfe0-a6c37b9e21c5\") " Jul 11 01:38:45.857878 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:45.857756 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27e47a0d-065d-4421-bfe0-a6c37b9e21c5-istio-data\") pod \"27e47a0d-065d-4421-bfe0-a6c37b9e21c5\" (UID: \"27e47a0d-065d-4421-bfe0-a6c37b9e21c5\") " Jul 11 01:38:45.857878 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:45.857789 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27e47a0d-065d-4421-bfe0-a6c37b9e21c5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "27e47a0d-065d-4421-bfe0-a6c37b9e21c5" (UID: "27e47a0d-065d-4421-bfe0-a6c37b9e21c5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 01:38:45.857878 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:45.857806 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27e47a0d-065d-4421-bfe0-a6c37b9e21c5-credential-socket\") pod \"27e47a0d-065d-4421-bfe0-a6c37b9e21c5\" (UID: \"27e47a0d-065d-4421-bfe0-a6c37b9e21c5\") " Jul 11 01:38:45.858126 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:45.858095 2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27e47a0d-065d-4421-bfe0-a6c37b9e21c5-workload-socket\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:38:45.858126 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:45.858115 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27e47a0d-065d-4421-bfe0-a6c37b9e21c5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "27e47a0d-065d-4421-bfe0-a6c37b9e21c5" (UID: "27e47a0d-065d-4421-bfe0-a6c37b9e21c5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 11 01:38:45.858234 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:45.858142 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27e47a0d-065d-4421-bfe0-a6c37b9e21c5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "27e47a0d-065d-4421-bfe0-a6c37b9e21c5" (UID: "27e47a0d-065d-4421-bfe0-a6c37b9e21c5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 01:38:45.858326 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:45.858298 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27e47a0d-065d-4421-bfe0-a6c37b9e21c5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "27e47a0d-065d-4421-bfe0-a6c37b9e21c5" (UID: "27e47a0d-065d-4421-bfe0-a6c37b9e21c5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 01:38:45.859129 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:45.859100 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27e47a0d-065d-4421-bfe0-a6c37b9e21c5-istio-data" (OuterVolumeSpecName: "istio-data") pod "27e47a0d-065d-4421-bfe0-a6c37b9e21c5" (UID: "27e47a0d-065d-4421-bfe0-a6c37b9e21c5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 01:38:45.860114 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:45.860078 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27e47a0d-065d-4421-bfe0-a6c37b9e21c5-kube-api-access-47rqk" (OuterVolumeSpecName: "kube-api-access-47rqk") pod "27e47a0d-065d-4421-bfe0-a6c37b9e21c5" (UID: "27e47a0d-065d-4421-bfe0-a6c37b9e21c5"). InnerVolumeSpecName "kube-api-access-47rqk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 11 01:38:45.860211 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:45.860187 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/27e47a0d-065d-4421-bfe0-a6c37b9e21c5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "27e47a0d-065d-4421-bfe0-a6c37b9e21c5" (UID: "27e47a0d-065d-4421-bfe0-a6c37b9e21c5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 11 01:38:45.860263 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:45.860190 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27e47a0d-065d-4421-bfe0-a6c37b9e21c5-istio-token" (OuterVolumeSpecName: "istio-token") pod "27e47a0d-065d-4421-bfe0-a6c37b9e21c5" (UID: "27e47a0d-065d-4421-bfe0-a6c37b9e21c5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 11 01:38:45.860423 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:45.860401 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27e47a0d-065d-4421-bfe0-a6c37b9e21c5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "27e47a0d-065d-4421-bfe0-a6c37b9e21c5" (UID: "27e47a0d-065d-4421-bfe0-a6c37b9e21c5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 01:38:45.958613 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:45.958578 2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27e47a0d-065d-4421-bfe0-a6c37b9e21c5-credential-socket\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:38:45.958613 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:45.958604 2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27e47a0d-065d-4421-bfe0-a6c37b9e21c5-istio-podinfo\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:38:45.958613 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:45.958614 2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27e47a0d-065d-4421-bfe0-a6c37b9e21c5-istio-token\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:38:45.958884 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:45.958622 2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27e47a0d-065d-4421-bfe0-a6c37b9e21c5-istio-envoy\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:38:45.958884 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:45.958644 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-47rqk\" (UniqueName: \"kubernetes.io/projected/27e47a0d-065d-4421-bfe0-a6c37b9e21c5-kube-api-access-47rqk\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:38:45.958884 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:45.958655 2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27e47a0d-065d-4421-bfe0-a6c37b9e21c5-istiod-ca-cert\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:38:45.958884 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:45.958663 2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27e47a0d-065d-4421-bfe0-a6c37b9e21c5-workload-certs\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:38:45.958884 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:45.958670 2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27e47a0d-065d-4421-bfe0-a6c37b9e21c5-istio-data\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:38:46.516445 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:46.516069 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h"] Jul 11 01:38:46.516615 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:46.516510 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62f7c56b-3e2c-4caf-8626-43bfa5183731" containerName="istio-proxy" Jul 11 01:38:46.516615 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:46.516525 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="62f7c56b-3e2c-4caf-8626-43bfa5183731" containerName="istio-proxy" Jul 11 01:38:46.516615 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:46.516543 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27e47a0d-065d-4421-bfe0-a6c37b9e21c5" containerName="istio-proxy" Jul 11 01:38:46.516615 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:46.516552 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="27e47a0d-065d-4421-bfe0-a6c37b9e21c5" containerName="istio-proxy" Jul 11 01:38:46.516615 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:46.516575 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27e47a0d-065d-4421-bfe0-a6c37b9e21c5" containerName="istio-proxy" Jul 11 01:38:46.516615 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:46.516584 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="27e47a0d-065d-4421-bfe0-a6c37b9e21c5" containerName="istio-proxy" Jul 11 01:38:46.516952 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:46.516649 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="62f7c56b-3e2c-4caf-8626-43bfa5183731" containerName="istio-proxy" Jul 11 01:38:46.516952 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:46.516660 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="62f7c56b-3e2c-4caf-8626-43bfa5183731" containerName="istio-proxy" Jul 11 01:38:46.516952 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:46.516670 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="27e47a0d-065d-4421-bfe0-a6c37b9e21c5" containerName="istio-proxy" Jul 11 01:38:46.516952 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:46.516681 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="27e47a0d-065d-4421-bfe0-a6c37b9e21c5" containerName="istio-proxy" Jul 11 01:38:46.520059 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:46.520028 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h" Jul 11 01:38:46.522456 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:46.522434 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-0e2b807a-openshift-default-dockercfg-p8vnk\"" Jul 11 01:38:46.532373 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:46.532343 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h"] Jul 11 01:38:46.664056 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:46.664018 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjcpr\" (UniqueName: \"kubernetes.io/projected/a36eb288-d6c3-47e1-9dc6-c7d9af7afa30-kube-api-access-jjcpr\") pod \"e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h\" (UID: \"a36eb288-d6c3-47e1-9dc6-c7d9af7afa30\") " pod="openshift-ingress/e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h" Jul 11 01:38:46.664241 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:46.664067 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a36eb288-d6c3-47e1-9dc6-c7d9af7afa30-istio-data\") pod \"e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h\" (UID: \"a36eb288-d6c3-47e1-9dc6-c7d9af7afa30\") " pod="openshift-ingress/e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h" Jul 11 01:38:46.664241 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:46.664136 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a36eb288-d6c3-47e1-9dc6-c7d9af7afa30-istiod-ca-cert\") pod \"e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h\" (UID: \"a36eb288-d6c3-47e1-9dc6-c7d9af7afa30\") " pod="openshift-ingress/e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h" Jul 11 01:38:46.664241 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:46.664188 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a36eb288-d6c3-47e1-9dc6-c7d9af7afa30-istio-podinfo\") pod \"e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h\" (UID: \"a36eb288-d6c3-47e1-9dc6-c7d9af7afa30\") " pod="openshift-ingress/e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h" Jul 11 01:38:46.664241 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:46.664240 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a36eb288-d6c3-47e1-9dc6-c7d9af7afa30-istio-token\") pod \"e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h\" (UID: \"a36eb288-d6c3-47e1-9dc6-c7d9af7afa30\") " pod="openshift-ingress/e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h" Jul 11 01:38:46.664371 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:46.664272 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a36eb288-d6c3-47e1-9dc6-c7d9af7afa30-workload-certs\") pod \"e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h\" (UID: \"a36eb288-d6c3-47e1-9dc6-c7d9af7afa30\") " pod="openshift-ingress/e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h" Jul 11 01:38:46.664371 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:46.664304 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a36eb288-d6c3-47e1-9dc6-c7d9af7afa30-workload-socket\") pod \"e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h\" (UID: \"a36eb288-d6c3-47e1-9dc6-c7d9af7afa30\") " pod="openshift-ingress/e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h" Jul 11 01:38:46.664371 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:46.664332 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a36eb288-d6c3-47e1-9dc6-c7d9af7afa30-credential-socket\") pod \"e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h\" (UID: \"a36eb288-d6c3-47e1-9dc6-c7d9af7afa30\") " pod="openshift-ingress/e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h" Jul 11 01:38:46.664371 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:46.664353 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a36eb288-d6c3-47e1-9dc6-c7d9af7afa30-istio-envoy\") pod \"e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h\" (UID: \"a36eb288-d6c3-47e1-9dc6-c7d9af7afa30\") " pod="openshift-ingress/e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h" Jul 11 01:38:46.737301 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:46.737275 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q" Jul 11 01:38:46.737880 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:46.737305 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q" event={"ID":"27e47a0d-065d-4421-bfe0-a6c37b9e21c5","Type":"ContainerDied","Data":"417c1a9ed95e68f0b6f86ec1dde3e1e359c13ef576b665a0ca9f468e5eeb709a"} Jul 11 01:38:46.737880 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:46.737369 2572 scope.go:117] "RemoveContainer" containerID="c8160e968146a196fb91d75096e6413f2a440226047c5507de3b1b298e68b248" Jul 11 01:38:46.757131 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:46.756468 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q"] Jul 11 01:38:46.762584 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:46.762556 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-5ecad626-gw-openshift-default-5c7b55fd9f-dgq8q"] Jul 11 01:38:46.764794 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:46.764776 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a36eb288-d6c3-47e1-9dc6-c7d9af7afa30-workload-socket\") pod \"e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h\" (UID: \"a36eb288-d6c3-47e1-9dc6-c7d9af7afa30\") " pod="openshift-ingress/e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h" Jul 11 01:38:46.764859 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:46.764804 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a36eb288-d6c3-47e1-9dc6-c7d9af7afa30-credential-socket\") pod \"e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h\" (UID: \"a36eb288-d6c3-47e1-9dc6-c7d9af7afa30\") " pod="openshift-ingress/e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h" Jul 11 01:38:46.764859 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:46.764826 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a36eb288-d6c3-47e1-9dc6-c7d9af7afa30-istio-envoy\") pod \"e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h\" (UID: \"a36eb288-d6c3-47e1-9dc6-c7d9af7afa30\") " pod="openshift-ingress/e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h" Jul 11 01:38:46.764964 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:46.764861 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjcpr\" (UniqueName: \"kubernetes.io/projected/a36eb288-d6c3-47e1-9dc6-c7d9af7afa30-kube-api-access-jjcpr\") pod \"e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h\" (UID: \"a36eb288-d6c3-47e1-9dc6-c7d9af7afa30\") " pod="openshift-ingress/e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h" Jul 11 01:38:46.764964 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:46.764899 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a36eb288-d6c3-47e1-9dc6-c7d9af7afa30-istio-data\") pod \"e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h\" (UID: \"a36eb288-d6c3-47e1-9dc6-c7d9af7afa30\") " pod="openshift-ingress/e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h" Jul 11 01:38:46.764964 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:46.764934 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a36eb288-d6c3-47e1-9dc6-c7d9af7afa30-istiod-ca-cert\") pod \"e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h\" (UID: \"a36eb288-d6c3-47e1-9dc6-c7d9af7afa30\") " pod="openshift-ingress/e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h" Jul 11 01:38:46.765096 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:46.764962 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a36eb288-d6c3-47e1-9dc6-c7d9af7afa30-istio-podinfo\") pod \"e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h\" (UID: \"a36eb288-d6c3-47e1-9dc6-c7d9af7afa30\") " pod="openshift-ingress/e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h" Jul 11 01:38:46.765096 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:46.764995 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a36eb288-d6c3-47e1-9dc6-c7d9af7afa30-istio-token\") pod \"e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h\" (UID: \"a36eb288-d6c3-47e1-9dc6-c7d9af7afa30\") " pod="openshift-ingress/e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h" Jul 11 01:38:46.765096 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:46.765032 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a36eb288-d6c3-47e1-9dc6-c7d9af7afa30-workload-certs\") pod \"e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h\" (UID: \"a36eb288-d6c3-47e1-9dc6-c7d9af7afa30\") " pod="openshift-ingress/e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h" Jul 11 01:38:46.765268 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:46.765236 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a36eb288-d6c3-47e1-9dc6-c7d9af7afa30-workload-socket\") pod \"e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h\" (UID: \"a36eb288-d6c3-47e1-9dc6-c7d9af7afa30\") " pod="openshift-ingress/e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h" Jul 11 01:38:46.765483 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:46.765456 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a36eb288-d6c3-47e1-9dc6-c7d9af7afa30-istio-data\") pod \"e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h\" (UID: \"a36eb288-d6c3-47e1-9dc6-c7d9af7afa30\") " pod="openshift-ingress/e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h" Jul 11 01:38:46.765595 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:46.765490 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a36eb288-d6c3-47e1-9dc6-c7d9af7afa30-workload-certs\") pod \"e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h\" (UID: \"a36eb288-d6c3-47e1-9dc6-c7d9af7afa30\") " pod="openshift-ingress/e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h" Jul 11 01:38:46.765595 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:46.765508 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a36eb288-d6c3-47e1-9dc6-c7d9af7afa30-credential-socket\") pod \"e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h\" (UID: \"a36eb288-d6c3-47e1-9dc6-c7d9af7afa30\") " pod="openshift-ingress/e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h" Jul 11 01:38:46.765735 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:46.765607 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a36eb288-d6c3-47e1-9dc6-c7d9af7afa30-istiod-ca-cert\") pod \"e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h\" (UID: \"a36eb288-d6c3-47e1-9dc6-c7d9af7afa30\") " pod="openshift-ingress/e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h" Jul 11 01:38:46.767303 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:46.767247 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a36eb288-d6c3-47e1-9dc6-c7d9af7afa30-istio-envoy\") pod \"e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h\" (UID: \"a36eb288-d6c3-47e1-9dc6-c7d9af7afa30\") " pod="openshift-ingress/e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h" Jul 11 01:38:46.767452 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:46.767431 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a36eb288-d6c3-47e1-9dc6-c7d9af7afa30-istio-podinfo\") pod \"e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h\" (UID: \"a36eb288-d6c3-47e1-9dc6-c7d9af7afa30\") " pod="openshift-ingress/e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h" Jul 11 01:38:46.772412 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:46.772389 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a36eb288-d6c3-47e1-9dc6-c7d9af7afa30-istio-token\") pod \"e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h\" (UID: \"a36eb288-d6c3-47e1-9dc6-c7d9af7afa30\") " pod="openshift-ingress/e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h" Jul 11 01:38:46.772522 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:46.772506 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjcpr\" (UniqueName: \"kubernetes.io/projected/a36eb288-d6c3-47e1-9dc6-c7d9af7afa30-kube-api-access-jjcpr\") pod \"e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h\" (UID: \"a36eb288-d6c3-47e1-9dc6-c7d9af7afa30\") " pod="openshift-ingress/e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h" Jul 11 01:38:46.832912 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:46.832868 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h" Jul 11 01:38:46.969857 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:46.969833 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h"] Jul 11 01:38:46.971647 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:38:46.971611 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda36eb288_d6c3_47e1_9dc6_c7d9af7afa30.slice/crio-4f9426a6ee48c8a7440f20158c358c5de01dfeea1ed99b90866f7c495a478e5e WatchSource:0}: Error finding container 4f9426a6ee48c8a7440f20158c358c5de01dfeea1ed99b90866f7c495a478e5e: Status 404 returned error can't find the container with id 4f9426a6ee48c8a7440f20158c358c5de01dfeea1ed99b90866f7c495a478e5e Jul 11 01:38:46.973920 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:46.973884 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:38:46.974014 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:46.973960 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:38:46.974014 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:46.973992 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:38:47.743629 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:47.743588 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h" event={"ID":"a36eb288-d6c3-47e1-9dc6-c7d9af7afa30","Type":"ContainerStarted","Data":"743a4e35c77487c7361c39198b0bf1c982a2c621a7e3c397262482dd7f740cf7"} Jul 11 01:38:47.744089 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:47.743645 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h" event={"ID":"a36eb288-d6c3-47e1-9dc6-c7d9af7afa30","Type":"ContainerStarted","Data":"4f9426a6ee48c8a7440f20158c358c5de01dfeea1ed99b90866f7c495a478e5e"} Jul 11 01:38:47.777144 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:47.777088 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h" podStartSLOduration=1.777073774 podStartE2EDuration="1.777073774s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:38:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:38:47.776186305 +0000 UTC m=+1932.107661860" watchObservedRunningTime="2026-07-11 01:38:47.777073774 +0000 UTC m=+1932.108549317" Jul 11 01:38:47.833721 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:47.833660 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h" Jul 11 01:38:48.256784 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:48.256747 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27e47a0d-065d-4421-bfe0-a6c37b9e21c5" path="/var/lib/kubelet/pods/27e47a0d-065d-4421-bfe0-a6c37b9e21c5/volumes" Jul 11 01:38:48.839213 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:48.839183 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h" Jul 11 01:38:49.752306 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:49.752277 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h" Jul 11 01:38:49.753321 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:49.753297 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h" Jul 11 01:38:58.797258 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:58.797220 2572 generic.go:356] "Generic (PLEG): container finished" podID="a36eb288-d6c3-47e1-9dc6-c7d9af7afa30" containerID="743a4e35c77487c7361c39198b0bf1c982a2c621a7e3c397262482dd7f740cf7" exitCode=0 Jul 11 01:38:58.797683 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:58.797280 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h" event={"ID":"a36eb288-d6c3-47e1-9dc6-c7d9af7afa30","Type":"ContainerDied","Data":"743a4e35c77487c7361c39198b0bf1c982a2c621a7e3c397262482dd7f740cf7"} Jul 11 01:38:58.797683 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:58.797651 2572 scope.go:117] "RemoveContainer" containerID="743a4e35c77487c7361c39198b0bf1c982a2c621a7e3c397262482dd7f740cf7" Jul 11 01:38:58.798682 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:58.798653 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:38:58.798801 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:58.798743 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:38:58.798801 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:58.798778 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:38:59.803278 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:59.803238 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h" event={"ID":"a36eb288-d6c3-47e1-9dc6-c7d9af7afa30","Type":"ContainerStarted","Data":"49d4e2ff0611a772b6b043e1b2f54ee0eb6d1662f7047cb3e683d98779781d63"} Jul 11 01:38:59.833999 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:59.833961 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h" Jul 11 01:38:59.834218 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:59.834193 2572 patch_prober.go:28] interesting pod/e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body= Jul 11 01:38:59.834272 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:38:59.834247 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h" podUID="a36eb288-d6c3-47e1-9dc6-c7d9af7afa30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" Jul 11 01:39:00.833876 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:39:00.833834 2572 patch_prober.go:28] interesting pod/e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body= Jul 11 01:39:00.834399 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:39:00.833910 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h" podUID="a36eb288-d6c3-47e1-9dc6-c7d9af7afa30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" Jul 11 01:39:01.833526 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:39:01.833473 2572 patch_prober.go:28] interesting pod/e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body= Jul 11 01:39:01.833765 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:39:01.833549 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h" podUID="a36eb288-d6c3-47e1-9dc6-c7d9af7afa30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" Jul 11 01:39:02.833652 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:39:02.833598 2572 patch_prober.go:28] interesting pod/e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body= Jul 11 01:39:02.834173 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:39:02.833674 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h" podUID="a36eb288-d6c3-47e1-9dc6-c7d9af7afa30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" Jul 11 01:39:03.833888 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:39:03.833846 2572 patch_prober.go:28] interesting pod/e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body= Jul 11 01:39:03.834374 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:39:03.833921 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h" podUID="a36eb288-d6c3-47e1-9dc6-c7d9af7afa30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" Jul 11 01:39:04.752677 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:39:04.752634 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h" Jul 11 01:39:04.837261 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:39:04.837229 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h" Jul 11 01:39:04.838222 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:39:04.838200 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h" Jul 11 01:40:08.917816 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:08.917780 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h"] Jul 11 01:40:08.918382 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:08.917991 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h" podUID="a36eb288-d6c3-47e1-9dc6-c7d9af7afa30" containerName="istio-proxy" containerID="cri-o://49d4e2ff0611a772b6b043e1b2f54ee0eb6d1662f7047cb3e683d98779781d63" gracePeriod=30 Jul 11 01:40:09.186257 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:09.186172 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r"] Jul 11 01:40:09.186498 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:09.186484 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62f7c56b-3e2c-4caf-8626-43bfa5183731" containerName="istio-proxy" Jul 11 01:40:09.186498 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:09.186497 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="62f7c56b-3e2c-4caf-8626-43bfa5183731" containerName="istio-proxy" Jul 11 01:40:09.189249 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:09.189225 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r" Jul 11 01:40:09.191547 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:09.191520 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-5db4a968-openshift-default-dockercfg-jtnqx\"" Jul 11 01:40:09.206208 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:09.206177 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r"] Jul 11 01:40:09.305930 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:09.305884 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/711dfe7a-5ca8-4ada-9143-c19de6f91a63-istio-data\") pod \"e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r\" (UID: \"711dfe7a-5ca8-4ada-9143-c19de6f91a63\") " pod="openshift-ingress/e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r" Jul 11 01:40:09.305930 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:09.305936 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/711dfe7a-5ca8-4ada-9143-c19de6f91a63-istio-podinfo\") pod \"e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r\" (UID: \"711dfe7a-5ca8-4ada-9143-c19de6f91a63\") " pod="openshift-ingress/e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r" Jul 11 01:40:09.306210 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:09.305964 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/711dfe7a-5ca8-4ada-9143-c19de6f91a63-istio-token\") pod \"e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r\" (UID: \"711dfe7a-5ca8-4ada-9143-c19de6f91a63\") " pod="openshift-ingress/e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r" Jul 11 01:40:09.306210 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:09.305989 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5x6fg\" (UniqueName: \"kubernetes.io/projected/711dfe7a-5ca8-4ada-9143-c19de6f91a63-kube-api-access-5x6fg\") pod \"e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r\" (UID: \"711dfe7a-5ca8-4ada-9143-c19de6f91a63\") " pod="openshift-ingress/e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r" Jul 11 01:40:09.306210 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:09.306027 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/711dfe7a-5ca8-4ada-9143-c19de6f91a63-istio-envoy\") pod \"e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r\" (UID: \"711dfe7a-5ca8-4ada-9143-c19de6f91a63\") " pod="openshift-ingress/e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r" Jul 11 01:40:09.306210 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:09.306059 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/711dfe7a-5ca8-4ada-9143-c19de6f91a63-istiod-ca-cert\") pod \"e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r\" (UID: \"711dfe7a-5ca8-4ada-9143-c19de6f91a63\") " pod="openshift-ingress/e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r" Jul 11 01:40:09.306210 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:09.306087 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/711dfe7a-5ca8-4ada-9143-c19de6f91a63-workload-socket\") pod \"e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r\" (UID: \"711dfe7a-5ca8-4ada-9143-c19de6f91a63\") " pod="openshift-ingress/e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r" Jul 11 01:40:09.306210 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:09.306110 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/711dfe7a-5ca8-4ada-9143-c19de6f91a63-credential-socket\") pod \"e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r\" (UID: \"711dfe7a-5ca8-4ada-9143-c19de6f91a63\") " pod="openshift-ingress/e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r" Jul 11 01:40:09.306510 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:09.306236 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/711dfe7a-5ca8-4ada-9143-c19de6f91a63-workload-certs\") pod \"e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r\" (UID: \"711dfe7a-5ca8-4ada-9143-c19de6f91a63\") " pod="openshift-ingress/e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r" Jul 11 01:40:09.407632 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:09.407589 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/711dfe7a-5ca8-4ada-9143-c19de6f91a63-istio-data\") pod \"e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r\" (UID: \"711dfe7a-5ca8-4ada-9143-c19de6f91a63\") " pod="openshift-ingress/e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r" Jul 11 01:40:09.407632 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:09.407628 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/711dfe7a-5ca8-4ada-9143-c19de6f91a63-istio-podinfo\") pod \"e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r\" (UID: \"711dfe7a-5ca8-4ada-9143-c19de6f91a63\") " pod="openshift-ingress/e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r" Jul 11 01:40:09.407928 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:09.407651 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/711dfe7a-5ca8-4ada-9143-c19de6f91a63-istio-token\") pod \"e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r\" (UID: \"711dfe7a-5ca8-4ada-9143-c19de6f91a63\") " pod="openshift-ingress/e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r" Jul 11 01:40:09.407928 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:09.407671 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5x6fg\" (UniqueName: \"kubernetes.io/projected/711dfe7a-5ca8-4ada-9143-c19de6f91a63-kube-api-access-5x6fg\") pod \"e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r\" (UID: \"711dfe7a-5ca8-4ada-9143-c19de6f91a63\") " pod="openshift-ingress/e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r" Jul 11 01:40:09.407928 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:09.407725 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/711dfe7a-5ca8-4ada-9143-c19de6f91a63-istio-envoy\") pod \"e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r\" (UID: \"711dfe7a-5ca8-4ada-9143-c19de6f91a63\") " pod="openshift-ingress/e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r" Jul 11 01:40:09.407928 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:09.407747 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/711dfe7a-5ca8-4ada-9143-c19de6f91a63-istiod-ca-cert\") pod \"e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r\" (UID: \"711dfe7a-5ca8-4ada-9143-c19de6f91a63\") " pod="openshift-ingress/e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r" Jul 11 01:40:09.407928 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:09.407765 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/711dfe7a-5ca8-4ada-9143-c19de6f91a63-workload-socket\") pod \"e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r\" (UID: \"711dfe7a-5ca8-4ada-9143-c19de6f91a63\") " pod="openshift-ingress/e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r" Jul 11 01:40:09.407928 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:09.407881 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/711dfe7a-5ca8-4ada-9143-c19de6f91a63-credential-socket\") pod \"e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r\" (UID: \"711dfe7a-5ca8-4ada-9143-c19de6f91a63\") " pod="openshift-ingress/e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r" Jul 11 01:40:09.408223 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:09.407989 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/711dfe7a-5ca8-4ada-9143-c19de6f91a63-workload-certs\") pod \"e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r\" (UID: \"711dfe7a-5ca8-4ada-9143-c19de6f91a63\") " pod="openshift-ingress/e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r" Jul 11 01:40:09.408223 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:09.408066 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/711dfe7a-5ca8-4ada-9143-c19de6f91a63-istio-data\") pod \"e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r\" (UID: \"711dfe7a-5ca8-4ada-9143-c19de6f91a63\") " pod="openshift-ingress/e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r" Jul 11 01:40:09.408352 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:09.408239 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/711dfe7a-5ca8-4ada-9143-c19de6f91a63-workload-socket\") pod \"e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r\" (UID: \"711dfe7a-5ca8-4ada-9143-c19de6f91a63\") " pod="openshift-ingress/e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r" Jul 11 01:40:09.408404 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:09.408369 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/711dfe7a-5ca8-4ada-9143-c19de6f91a63-workload-certs\") pod \"e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r\" (UID: \"711dfe7a-5ca8-4ada-9143-c19de6f91a63\") " pod="openshift-ingress/e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r" Jul 11 01:40:09.408404 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:09.408369 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/711dfe7a-5ca8-4ada-9143-c19de6f91a63-credential-socket\") pod \"e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r\" (UID: \"711dfe7a-5ca8-4ada-9143-c19de6f91a63\") " pod="openshift-ingress/e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r" Jul 11 01:40:09.408948 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:09.408921 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/711dfe7a-5ca8-4ada-9143-c19de6f91a63-istiod-ca-cert\") pod \"e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r\" (UID: \"711dfe7a-5ca8-4ada-9143-c19de6f91a63\") " pod="openshift-ingress/e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r" Jul 11 01:40:09.410080 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:09.410060 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/711dfe7a-5ca8-4ada-9143-c19de6f91a63-istio-envoy\") pod \"e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r\" (UID: \"711dfe7a-5ca8-4ada-9143-c19de6f91a63\") " pod="openshift-ingress/e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r" Jul 11 01:40:09.410319 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:09.410302 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/711dfe7a-5ca8-4ada-9143-c19de6f91a63-istio-podinfo\") pod \"e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r\" (UID: \"711dfe7a-5ca8-4ada-9143-c19de6f91a63\") " pod="openshift-ingress/e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r" Jul 11 01:40:09.418501 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:09.418466 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5x6fg\" (UniqueName: \"kubernetes.io/projected/711dfe7a-5ca8-4ada-9143-c19de6f91a63-kube-api-access-5x6fg\") pod \"e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r\" (UID: \"711dfe7a-5ca8-4ada-9143-c19de6f91a63\") " pod="openshift-ingress/e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r" Jul 11 01:40:09.418789 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:09.418769 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/711dfe7a-5ca8-4ada-9143-c19de6f91a63-istio-token\") pod \"e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r\" (UID: \"711dfe7a-5ca8-4ada-9143-c19de6f91a63\") " pod="openshift-ingress/e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r" Jul 11 01:40:09.500630 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:09.500588 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r" Jul 11 01:40:09.637896 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:09.637862 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r"] Jul 11 01:40:09.640629 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:40:09.640596 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod711dfe7a_5ca8_4ada_9143_c19de6f91a63.slice/crio-bb62bcec1a9791c34c8142ea3a6f96b30fe5a89434ad7791912d9fda31626e7a WatchSource:0}: Error finding container bb62bcec1a9791c34c8142ea3a6f96b30fe5a89434ad7791912d9fda31626e7a: Status 404 returned error can't find the container with id bb62bcec1a9791c34c8142ea3a6f96b30fe5a89434ad7791912d9fda31626e7a Jul 11 01:40:09.643155 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:09.643122 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:40:09.643246 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:09.643195 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:40:09.643246 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:09.643225 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:40:10.097803 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:10.097758 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r" event={"ID":"711dfe7a-5ca8-4ada-9143-c19de6f91a63","Type":"ContainerStarted","Data":"33a9769bc4a22c7cda702fa4bf214688d97bf78bb3e63e754513a9f0fbc75c94"} Jul 11 01:40:10.098185 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:10.097817 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r" event={"ID":"711dfe7a-5ca8-4ada-9143-c19de6f91a63","Type":"ContainerStarted","Data":"bb62bcec1a9791c34c8142ea3a6f96b30fe5a89434ad7791912d9fda31626e7a"} Jul 11 01:40:10.117307 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:10.116876 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r" podStartSLOduration=1.116854126 podStartE2EDuration="1.116854126s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:40:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:40:10.115642665 +0000 UTC m=+2014.447118233" watchObservedRunningTime="2026-07-11 01:40:10.116854126 +0000 UTC m=+2014.448329672" Jul 11 01:40:10.501552 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:10.501518 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r" Jul 11 01:40:10.506627 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:10.506600 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r" Jul 11 01:40:11.102419 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:11.102391 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r" Jul 11 01:40:11.103511 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:11.103486 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r" Jul 11 01:40:14.117617 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:14.117586 2572 generic.go:356] "Generic (PLEG): container finished" podID="a36eb288-d6c3-47e1-9dc6-c7d9af7afa30" containerID="49d4e2ff0611a772b6b043e1b2f54ee0eb6d1662f7047cb3e683d98779781d63" exitCode=0 Jul 11 01:40:14.118073 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:14.117654 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h" event={"ID":"a36eb288-d6c3-47e1-9dc6-c7d9af7afa30","Type":"ContainerDied","Data":"49d4e2ff0611a772b6b043e1b2f54ee0eb6d1662f7047cb3e683d98779781d63"} Jul 11 01:40:14.118073 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:14.117742 2572 scope.go:117] "RemoveContainer" containerID="743a4e35c77487c7361c39198b0bf1c982a2c621a7e3c397262482dd7f740cf7" Jul 11 01:40:14.216109 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:14.216082 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h" Jul 11 01:40:14.361323 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:14.361288 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a36eb288-d6c3-47e1-9dc6-c7d9af7afa30-istio-podinfo\") pod \"a36eb288-d6c3-47e1-9dc6-c7d9af7afa30\" (UID: \"a36eb288-d6c3-47e1-9dc6-c7d9af7afa30\") " Jul 11 01:40:14.361591 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:14.361340 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a36eb288-d6c3-47e1-9dc6-c7d9af7afa30-istio-data\") pod \"a36eb288-d6c3-47e1-9dc6-c7d9af7afa30\" (UID: \"a36eb288-d6c3-47e1-9dc6-c7d9af7afa30\") " Jul 11 01:40:14.361591 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:14.361366 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a36eb288-d6c3-47e1-9dc6-c7d9af7afa30-workload-socket\") pod \"a36eb288-d6c3-47e1-9dc6-c7d9af7afa30\" (UID: \"a36eb288-d6c3-47e1-9dc6-c7d9af7afa30\") " Jul 11 01:40:14.361591 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:14.361424 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a36eb288-d6c3-47e1-9dc6-c7d9af7afa30-istio-envoy\") pod \"a36eb288-d6c3-47e1-9dc6-c7d9af7afa30\" (UID: \"a36eb288-d6c3-47e1-9dc6-c7d9af7afa30\") " Jul 11 01:40:14.361591 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:14.361454 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a36eb288-d6c3-47e1-9dc6-c7d9af7afa30-workload-certs\") pod \"a36eb288-d6c3-47e1-9dc6-c7d9af7afa30\" (UID: \"a36eb288-d6c3-47e1-9dc6-c7d9af7afa30\") " Jul 11 01:40:14.361591 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:14.361483 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a36eb288-d6c3-47e1-9dc6-c7d9af7afa30-istiod-ca-cert\") pod \"a36eb288-d6c3-47e1-9dc6-c7d9af7afa30\" (UID: \"a36eb288-d6c3-47e1-9dc6-c7d9af7afa30\") " Jul 11 01:40:14.361591 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:14.361524 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jjcpr\" (UniqueName: \"kubernetes.io/projected/a36eb288-d6c3-47e1-9dc6-c7d9af7afa30-kube-api-access-jjcpr\") pod \"a36eb288-d6c3-47e1-9dc6-c7d9af7afa30\" (UID: \"a36eb288-d6c3-47e1-9dc6-c7d9af7afa30\") " Jul 11 01:40:14.361591 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:14.361550 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a36eb288-d6c3-47e1-9dc6-c7d9af7afa30-credential-socket\") pod \"a36eb288-d6c3-47e1-9dc6-c7d9af7afa30\" (UID: \"a36eb288-d6c3-47e1-9dc6-c7d9af7afa30\") " Jul 11 01:40:14.361591 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:14.361580 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a36eb288-d6c3-47e1-9dc6-c7d9af7afa30-istio-token\") pod \"a36eb288-d6c3-47e1-9dc6-c7d9af7afa30\" (UID: \"a36eb288-d6c3-47e1-9dc6-c7d9af7afa30\") " Jul 11 01:40:14.362001 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:14.361922 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a36eb288-d6c3-47e1-9dc6-c7d9af7afa30-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a36eb288-d6c3-47e1-9dc6-c7d9af7afa30" (UID: "a36eb288-d6c3-47e1-9dc6-c7d9af7afa30"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 01:40:14.362097 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:14.362076 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a36eb288-d6c3-47e1-9dc6-c7d9af7afa30-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a36eb288-d6c3-47e1-9dc6-c7d9af7afa30" (UID: "a36eb288-d6c3-47e1-9dc6-c7d9af7afa30"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 01:40:14.362416 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:14.362384 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a36eb288-d6c3-47e1-9dc6-c7d9af7afa30-istio-data" (OuterVolumeSpecName: "istio-data") pod "a36eb288-d6c3-47e1-9dc6-c7d9af7afa30" (UID: "a36eb288-d6c3-47e1-9dc6-c7d9af7afa30"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 01:40:14.362677 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:14.362628 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a36eb288-d6c3-47e1-9dc6-c7d9af7afa30-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a36eb288-d6c3-47e1-9dc6-c7d9af7afa30" (UID: "a36eb288-d6c3-47e1-9dc6-c7d9af7afa30"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 01:40:14.362810 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:14.362759 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a36eb288-d6c3-47e1-9dc6-c7d9af7afa30-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a36eb288-d6c3-47e1-9dc6-c7d9af7afa30" (UID: "a36eb288-d6c3-47e1-9dc6-c7d9af7afa30"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 11 01:40:14.364156 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:14.364135 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a36eb288-d6c3-47e1-9dc6-c7d9af7afa30-istio-token" (OuterVolumeSpecName: "istio-token") pod "a36eb288-d6c3-47e1-9dc6-c7d9af7afa30" (UID: "a36eb288-d6c3-47e1-9dc6-c7d9af7afa30"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 11 01:40:14.364665 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:14.364636 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a36eb288-d6c3-47e1-9dc6-c7d9af7afa30-kube-api-access-jjcpr" (OuterVolumeSpecName: "kube-api-access-jjcpr") pod "a36eb288-d6c3-47e1-9dc6-c7d9af7afa30" (UID: "a36eb288-d6c3-47e1-9dc6-c7d9af7afa30"). InnerVolumeSpecName "kube-api-access-jjcpr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 11 01:40:14.364895 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:14.364879 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a36eb288-d6c3-47e1-9dc6-c7d9af7afa30-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a36eb288-d6c3-47e1-9dc6-c7d9af7afa30" (UID: "a36eb288-d6c3-47e1-9dc6-c7d9af7afa30"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 11 01:40:14.364947 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:14.364893 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a36eb288-d6c3-47e1-9dc6-c7d9af7afa30-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a36eb288-d6c3-47e1-9dc6-c7d9af7afa30" (UID: "a36eb288-d6c3-47e1-9dc6-c7d9af7afa30"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 01:40:14.463336 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:14.463224 2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a36eb288-d6c3-47e1-9dc6-c7d9af7afa30-istio-token\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:40:14.463336 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:14.463264 2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a36eb288-d6c3-47e1-9dc6-c7d9af7afa30-istio-podinfo\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:40:14.463336 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:14.463276 2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a36eb288-d6c3-47e1-9dc6-c7d9af7afa30-istio-data\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:40:14.463336 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:14.463290 2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a36eb288-d6c3-47e1-9dc6-c7d9af7afa30-workload-socket\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:40:14.463336 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:14.463301 2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a36eb288-d6c3-47e1-9dc6-c7d9af7afa30-istio-envoy\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:40:14.463336 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:14.463313 2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a36eb288-d6c3-47e1-9dc6-c7d9af7afa30-workload-certs\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:40:14.463336 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:14.463323 2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a36eb288-d6c3-47e1-9dc6-c7d9af7afa30-istiod-ca-cert\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:40:14.463336 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:14.463334 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jjcpr\" (UniqueName: \"kubernetes.io/projected/a36eb288-d6c3-47e1-9dc6-c7d9af7afa30-kube-api-access-jjcpr\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:40:14.463720 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:14.463347 2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a36eb288-d6c3-47e1-9dc6-c7d9af7afa30-credential-socket\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:40:15.123261 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:15.123227 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h" Jul 11 01:40:15.123723 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:15.123264 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h" event={"ID":"a36eb288-d6c3-47e1-9dc6-c7d9af7afa30","Type":"ContainerDied","Data":"4f9426a6ee48c8a7440f20158c358c5de01dfeea1ed99b90866f7c495a478e5e"} Jul 11 01:40:15.123723 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:15.123319 2572 scope.go:117] "RemoveContainer" containerID="49d4e2ff0611a772b6b043e1b2f54ee0eb6d1662f7047cb3e683d98779781d63" Jul 11 01:40:15.145338 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:15.145288 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h"] Jul 11 01:40:15.149664 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:15.149620 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-0e2b807a-openshift-default-665bf7c7-z7w6h"] Jul 11 01:40:16.259315 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:16.259274 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a36eb288-d6c3-47e1-9dc6-c7d9af7afa30" path="/var/lib/kubelet/pods/a36eb288-d6c3-47e1-9dc6-c7d9af7afa30/volumes" Jul 11 01:40:21.151738 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:21.151618 2572 generic.go:356] "Generic (PLEG): container finished" podID="711dfe7a-5ca8-4ada-9143-c19de6f91a63" containerID="33a9769bc4a22c7cda702fa4bf214688d97bf78bb3e63e754513a9f0fbc75c94" exitCode=0 Jul 11 01:40:21.151738 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:21.151712 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r" event={"ID":"711dfe7a-5ca8-4ada-9143-c19de6f91a63","Type":"ContainerDied","Data":"33a9769bc4a22c7cda702fa4bf214688d97bf78bb3e63e754513a9f0fbc75c94"} Jul 11 01:40:21.152179 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:21.152118 2572 scope.go:117] "RemoveContainer" containerID="33a9769bc4a22c7cda702fa4bf214688d97bf78bb3e63e754513a9f0fbc75c94" Jul 11 01:40:21.153251 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:21.153226 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:40:21.153314 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:21.153299 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:40:21.153356 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:21.153335 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:40:22.160418 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:22.160377 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r" event={"ID":"711dfe7a-5ca8-4ada-9143-c19de6f91a63","Type":"ContainerStarted","Data":"8e23389a30146ab50ae958607c46805f165a4ded21f7068bd71ba6367575be40"} Jul 11 01:40:22.501122 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:22.501078 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r" Jul 11 01:40:22.502263 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:22.502239 2572 patch_prober.go:28] interesting pod/e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body= Jul 11 01:40:22.502326 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:22.502291 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r" podUID="711dfe7a-5ca8-4ada-9143-c19de6f91a63" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" Jul 11 01:40:23.501956 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:23.501913 2572 patch_prober.go:28] interesting pod/e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body= Jul 11 01:40:23.502357 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:23.501977 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r" podUID="711dfe7a-5ca8-4ada-9143-c19de6f91a63" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" Jul 11 01:40:24.501863 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:24.501825 2572 patch_prober.go:28] interesting pod/e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body= Jul 11 01:40:24.502055 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:24.501886 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r" podUID="711dfe7a-5ca8-4ada-9143-c19de6f91a63" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" Jul 11 01:40:25.501757 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:25.501685 2572 patch_prober.go:28] interesting pod/e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body= Jul 11 01:40:25.501941 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:25.501775 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r" podUID="711dfe7a-5ca8-4ada-9143-c19de6f91a63" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" Jul 11 01:40:26.103153 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:26.103116 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r" Jul 11 01:40:26.505335 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:26.505305 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r" Jul 11 01:40:26.506290 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:40:26.506273 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r" Jul 11 01:41:40.008983 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:41:40.008945 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r"] Jul 11 01:41:40.009471 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:41:40.009168 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r" podUID="711dfe7a-5ca8-4ada-9143-c19de6f91a63" containerName="istio-proxy" containerID="cri-o://8e23389a30146ab50ae958607c46805f165a4ded21f7068bd71ba6367575be40" gracePeriod=30 Jul 11 01:41:41.508246 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:41:41.508210 2572 patch_prober.go:28] interesting pod/e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 11 01:41:41.508719 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:41:41.508309 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r" podUID="711dfe7a-5ca8-4ada-9143-c19de6f91a63" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 11 01:41:45.267371 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:41:45.267341 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r" Jul 11 01:41:45.358155 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:41:45.358122 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5x6fg\" (UniqueName: \"kubernetes.io/projected/711dfe7a-5ca8-4ada-9143-c19de6f91a63-kube-api-access-5x6fg\") pod \"711dfe7a-5ca8-4ada-9143-c19de6f91a63\" (UID: \"711dfe7a-5ca8-4ada-9143-c19de6f91a63\") " Jul 11 01:41:45.358320 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:41:45.358197 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/711dfe7a-5ca8-4ada-9143-c19de6f91a63-workload-certs\") pod \"711dfe7a-5ca8-4ada-9143-c19de6f91a63\" (UID: \"711dfe7a-5ca8-4ada-9143-c19de6f91a63\") " Jul 11 01:41:45.358320 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:41:45.358217 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/711dfe7a-5ca8-4ada-9143-c19de6f91a63-istio-envoy\") pod \"711dfe7a-5ca8-4ada-9143-c19de6f91a63\" (UID: \"711dfe7a-5ca8-4ada-9143-c19de6f91a63\") " Jul 11 01:41:45.358320 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:41:45.358259 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/711dfe7a-5ca8-4ada-9143-c19de6f91a63-workload-socket\") pod \"711dfe7a-5ca8-4ada-9143-c19de6f91a63\" (UID: \"711dfe7a-5ca8-4ada-9143-c19de6f91a63\") " Jul 11 01:41:45.358320 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:41:45.358292 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/711dfe7a-5ca8-4ada-9143-c19de6f91a63-credential-socket\") pod \"711dfe7a-5ca8-4ada-9143-c19de6f91a63\" (UID: \"711dfe7a-5ca8-4ada-9143-c19de6f91a63\") " Jul 11 01:41:45.358526 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:41:45.358324 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/711dfe7a-5ca8-4ada-9143-c19de6f91a63-istio-token\") pod \"711dfe7a-5ca8-4ada-9143-c19de6f91a63\" (UID: \"711dfe7a-5ca8-4ada-9143-c19de6f91a63\") " Jul 11 01:41:45.358526 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:41:45.358368 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/711dfe7a-5ca8-4ada-9143-c19de6f91a63-istiod-ca-cert\") pod \"711dfe7a-5ca8-4ada-9143-c19de6f91a63\" (UID: \"711dfe7a-5ca8-4ada-9143-c19de6f91a63\") " Jul 11 01:41:45.358526 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:41:45.358397 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/711dfe7a-5ca8-4ada-9143-c19de6f91a63-istio-data\") pod \"711dfe7a-5ca8-4ada-9143-c19de6f91a63\" (UID: \"711dfe7a-5ca8-4ada-9143-c19de6f91a63\") " Jul 11 01:41:45.358526 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:41:45.358423 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/711dfe7a-5ca8-4ada-9143-c19de6f91a63-istio-podinfo\") pod \"711dfe7a-5ca8-4ada-9143-c19de6f91a63\" (UID: \"711dfe7a-5ca8-4ada-9143-c19de6f91a63\") " Jul 11 01:41:45.358774 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:41:45.358540 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/711dfe7a-5ca8-4ada-9143-c19de6f91a63-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "711dfe7a-5ca8-4ada-9143-c19de6f91a63" (UID: "711dfe7a-5ca8-4ada-9143-c19de6f91a63"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 01:41:45.358774 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:41:45.358553 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/711dfe7a-5ca8-4ada-9143-c19de6f91a63-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "711dfe7a-5ca8-4ada-9143-c19de6f91a63" (UID: "711dfe7a-5ca8-4ada-9143-c19de6f91a63"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 01:41:45.358774 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:41:45.358643 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/711dfe7a-5ca8-4ada-9143-c19de6f91a63-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "711dfe7a-5ca8-4ada-9143-c19de6f91a63" (UID: "711dfe7a-5ca8-4ada-9143-c19de6f91a63"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 01:41:45.358934 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:41:45.358804 2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/711dfe7a-5ca8-4ada-9143-c19de6f91a63-workload-certs\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:41:45.358934 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:41:45.358825 2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/711dfe7a-5ca8-4ada-9143-c19de6f91a63-workload-socket\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:41:45.358934 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:41:45.358839 2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/711dfe7a-5ca8-4ada-9143-c19de6f91a63-credential-socket\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:41:45.358934 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:41:45.358859 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/711dfe7a-5ca8-4ada-9143-c19de6f91a63-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "711dfe7a-5ca8-4ada-9143-c19de6f91a63" (UID: "711dfe7a-5ca8-4ada-9143-c19de6f91a63"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 11 01:41:45.359642 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:41:45.359612 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/711dfe7a-5ca8-4ada-9143-c19de6f91a63-istio-data" (OuterVolumeSpecName: "istio-data") pod "711dfe7a-5ca8-4ada-9143-c19de6f91a63" (UID: "711dfe7a-5ca8-4ada-9143-c19de6f91a63"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 01:41:45.360483 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:41:45.360452 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/711dfe7a-5ca8-4ada-9143-c19de6f91a63-kube-api-access-5x6fg" (OuterVolumeSpecName: "kube-api-access-5x6fg") pod "711dfe7a-5ca8-4ada-9143-c19de6f91a63" (UID: "711dfe7a-5ca8-4ada-9143-c19de6f91a63"). InnerVolumeSpecName "kube-api-access-5x6fg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 11 01:41:45.360643 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:41:45.360620 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/711dfe7a-5ca8-4ada-9143-c19de6f91a63-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "711dfe7a-5ca8-4ada-9143-c19de6f91a63" (UID: "711dfe7a-5ca8-4ada-9143-c19de6f91a63"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 11 01:41:45.360798 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:41:45.360776 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/711dfe7a-5ca8-4ada-9143-c19de6f91a63-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "711dfe7a-5ca8-4ada-9143-c19de6f91a63" (UID: "711dfe7a-5ca8-4ada-9143-c19de6f91a63"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 01:41:45.360877 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:41:45.360857 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/711dfe7a-5ca8-4ada-9143-c19de6f91a63-istio-token" (OuterVolumeSpecName: "istio-token") pod "711dfe7a-5ca8-4ada-9143-c19de6f91a63" (UID: "711dfe7a-5ca8-4ada-9143-c19de6f91a63"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 11 01:41:45.460077 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:41:45.460031 2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/711dfe7a-5ca8-4ada-9143-c19de6f91a63-istio-token\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:41:45.460077 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:41:45.460070 2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/711dfe7a-5ca8-4ada-9143-c19de6f91a63-istiod-ca-cert\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:41:45.460077 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:41:45.460082 2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/711dfe7a-5ca8-4ada-9143-c19de6f91a63-istio-data\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:41:45.460325 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:41:45.460092 2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/711dfe7a-5ca8-4ada-9143-c19de6f91a63-istio-podinfo\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:41:45.460325 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:41:45.460105 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5x6fg\" (UniqueName: \"kubernetes.io/projected/711dfe7a-5ca8-4ada-9143-c19de6f91a63-kube-api-access-5x6fg\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:41:45.460325 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:41:45.460117 2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/711dfe7a-5ca8-4ada-9143-c19de6f91a63-istio-envoy\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:41:45.499631 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:41:45.499598 2572 generic.go:356] "Generic (PLEG): container finished" podID="711dfe7a-5ca8-4ada-9143-c19de6f91a63" containerID="8e23389a30146ab50ae958607c46805f165a4ded21f7068bd71ba6367575be40" exitCode=0 Jul 11 01:41:45.499817 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:41:45.499644 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r" Jul 11 01:41:45.499817 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:41:45.499687 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r" event={"ID":"711dfe7a-5ca8-4ada-9143-c19de6f91a63","Type":"ContainerDied","Data":"8e23389a30146ab50ae958607c46805f165a4ded21f7068bd71ba6367575be40"} Jul 11 01:41:45.499817 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:41:45.499766 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r" event={"ID":"711dfe7a-5ca8-4ada-9143-c19de6f91a63","Type":"ContainerDied","Data":"bb62bcec1a9791c34c8142ea3a6f96b30fe5a89434ad7791912d9fda31626e7a"} Jul 11 01:41:45.499817 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:41:45.499792 2572 scope.go:117] "RemoveContainer" containerID="8e23389a30146ab50ae958607c46805f165a4ded21f7068bd71ba6367575be40" Jul 11 01:41:45.513387 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:41:45.513365 2572 scope.go:117] "RemoveContainer" containerID="33a9769bc4a22c7cda702fa4bf214688d97bf78bb3e63e754513a9f0fbc75c94" Jul 11 01:41:45.521387 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:41:45.521360 2572 scope.go:117] "RemoveContainer" containerID="8e23389a30146ab50ae958607c46805f165a4ded21f7068bd71ba6367575be40" Jul 11 01:41:45.521899 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:41:45.521832 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e23389a30146ab50ae958607c46805f165a4ded21f7068bd71ba6367575be40\": container with ID starting with 8e23389a30146ab50ae958607c46805f165a4ded21f7068bd71ba6367575be40 not found: ID does not exist" containerID="8e23389a30146ab50ae958607c46805f165a4ded21f7068bd71ba6367575be40" Jul 11 01:41:45.521899 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:41:45.521873 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e23389a30146ab50ae958607c46805f165a4ded21f7068bd71ba6367575be40"} err="failed to get container status \"8e23389a30146ab50ae958607c46805f165a4ded21f7068bd71ba6367575be40\": rpc error: code = NotFound desc = could not find container \"8e23389a30146ab50ae958607c46805f165a4ded21f7068bd71ba6367575be40\": container with ID starting with 8e23389a30146ab50ae958607c46805f165a4ded21f7068bd71ba6367575be40 not found: ID does not exist" Jul 11 01:41:45.521899 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:41:45.521901 2572 scope.go:117] "RemoveContainer" containerID="33a9769bc4a22c7cda702fa4bf214688d97bf78bb3e63e754513a9f0fbc75c94" Jul 11 01:41:45.522299 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:41:45.522251 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33a9769bc4a22c7cda702fa4bf214688d97bf78bb3e63e754513a9f0fbc75c94\": container with ID starting with 33a9769bc4a22c7cda702fa4bf214688d97bf78bb3e63e754513a9f0fbc75c94 not found: ID does not exist" containerID="33a9769bc4a22c7cda702fa4bf214688d97bf78bb3e63e754513a9f0fbc75c94" Jul 11 01:41:45.522370 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:41:45.522300 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33a9769bc4a22c7cda702fa4bf214688d97bf78bb3e63e754513a9f0fbc75c94"} err="failed to get container status \"33a9769bc4a22c7cda702fa4bf214688d97bf78bb3e63e754513a9f0fbc75c94\": rpc error: code = NotFound desc = could not find container \"33a9769bc4a22c7cda702fa4bf214688d97bf78bb3e63e754513a9f0fbc75c94\": container with ID starting with 33a9769bc4a22c7cda702fa4bf214688d97bf78bb3e63e754513a9f0fbc75c94 not found: ID does not exist" Jul 11 01:41:45.524087 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:41:45.524068 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r"] Jul 11 01:41:45.529389 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:41:45.529364 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-5db4a968-openshift-default-76474c96f5-8qc6r"] Jul 11 01:41:46.256526 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:41:46.256489 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="711dfe7a-5ca8-4ada-9143-c19de6f91a63" path="/var/lib/kubelet/pods/711dfe7a-5ca8-4ada-9143-c19de6f91a63/volumes" Jul 11 01:43:14.129913 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:14.129872 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-37fb922a-openshift-default-c654c65f-94rgb"] Jul 11 01:43:14.131101 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:14.131072 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a36eb288-d6c3-47e1-9dc6-c7d9af7afa30" containerName="istio-proxy" Jul 11 01:43:14.131254 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:14.131242 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a36eb288-d6c3-47e1-9dc6-c7d9af7afa30" containerName="istio-proxy" Jul 11 01:43:14.131331 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:14.131322 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="711dfe7a-5ca8-4ada-9143-c19de6f91a63" containerName="istio-proxy" Jul 11 01:43:14.131399 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:14.131391 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="711dfe7a-5ca8-4ada-9143-c19de6f91a63" containerName="istio-proxy" Jul 11 01:43:14.131479 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:14.131470 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a36eb288-d6c3-47e1-9dc6-c7d9af7afa30" containerName="istio-proxy" Jul 11 01:43:14.131548 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:14.131539 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a36eb288-d6c3-47e1-9dc6-c7d9af7afa30" containerName="istio-proxy" Jul 11 01:43:14.131783 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:14.131768 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="a36eb288-d6c3-47e1-9dc6-c7d9af7afa30" containerName="istio-proxy" Jul 11 01:43:14.131884 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:14.131874 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="711dfe7a-5ca8-4ada-9143-c19de6f91a63" containerName="istio-proxy" Jul 11 01:43:14.131962 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:14.131953 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="711dfe7a-5ca8-4ada-9143-c19de6f91a63" containerName="istio-proxy" Jul 11 01:43:14.135502 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:14.135477 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-37fb922a-openshift-default-c654c65f-94rgb" Jul 11 01:43:14.138002 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:14.137986 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-37fb922a-openshift-default-dockercfg-fdcpz\"" Jul 11 01:43:14.141450 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:14.141421 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-37fb922a-openshift-default-c654c65f-94rgb"] Jul 11 01:43:14.226900 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:14.218986 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92657f17-c9fe-44c7-a3f7-63e301e100ed-istio-envoy\") pod \"e2e-mt-37fb922a-openshift-default-c654c65f-94rgb\" (UID: \"92657f17-c9fe-44c7-a3f7-63e301e100ed\") " pod="openshift-ingress/e2e-mt-37fb922a-openshift-default-c654c65f-94rgb" Jul 11 01:43:14.227325 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:14.227270 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92657f17-c9fe-44c7-a3f7-63e301e100ed-istiod-ca-cert\") pod \"e2e-mt-37fb922a-openshift-default-c654c65f-94rgb\" (UID: \"92657f17-c9fe-44c7-a3f7-63e301e100ed\") " pod="openshift-ingress/e2e-mt-37fb922a-openshift-default-c654c65f-94rgb" Jul 11 01:43:14.227471 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:14.227395 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92657f17-c9fe-44c7-a3f7-63e301e100ed-credential-socket\") pod \"e2e-mt-37fb922a-openshift-default-c654c65f-94rgb\" (UID: \"92657f17-c9fe-44c7-a3f7-63e301e100ed\") " pod="openshift-ingress/e2e-mt-37fb922a-openshift-default-c654c65f-94rgb" Jul 11 01:43:14.227471 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:14.227452 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92657f17-c9fe-44c7-a3f7-63e301e100ed-workload-socket\") pod \"e2e-mt-37fb922a-openshift-default-c654c65f-94rgb\" (UID: \"92657f17-c9fe-44c7-a3f7-63e301e100ed\") " pod="openshift-ingress/e2e-mt-37fb922a-openshift-default-c654c65f-94rgb" Jul 11 01:43:14.227584 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:14.227499 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92657f17-c9fe-44c7-a3f7-63e301e100ed-istio-data\") pod \"e2e-mt-37fb922a-openshift-default-c654c65f-94rgb\" (UID: \"92657f17-c9fe-44c7-a3f7-63e301e100ed\") " pod="openshift-ingress/e2e-mt-37fb922a-openshift-default-c654c65f-94rgb" Jul 11 01:43:14.227625 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:14.227598 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92657f17-c9fe-44c7-a3f7-63e301e100ed-istio-podinfo\") pod \"e2e-mt-37fb922a-openshift-default-c654c65f-94rgb\" (UID: \"92657f17-c9fe-44c7-a3f7-63e301e100ed\") " pod="openshift-ingress/e2e-mt-37fb922a-openshift-default-c654c65f-94rgb" Jul 11 01:43:14.227670 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:14.227651 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtfrc\" (UniqueName: \"kubernetes.io/projected/92657f17-c9fe-44c7-a3f7-63e301e100ed-kube-api-access-vtfrc\") pod \"e2e-mt-37fb922a-openshift-default-c654c65f-94rgb\" (UID: \"92657f17-c9fe-44c7-a3f7-63e301e100ed\") " pod="openshift-ingress/e2e-mt-37fb922a-openshift-default-c654c65f-94rgb" Jul 11 01:43:14.227755 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:14.227685 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92657f17-c9fe-44c7-a3f7-63e301e100ed-workload-certs\") pod \"e2e-mt-37fb922a-openshift-default-c654c65f-94rgb\" (UID: \"92657f17-c9fe-44c7-a3f7-63e301e100ed\") " pod="openshift-ingress/e2e-mt-37fb922a-openshift-default-c654c65f-94rgb" Jul 11 01:43:14.227816 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:14.227792 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92657f17-c9fe-44c7-a3f7-63e301e100ed-istio-token\") pod \"e2e-mt-37fb922a-openshift-default-c654c65f-94rgb\" (UID: \"92657f17-c9fe-44c7-a3f7-63e301e100ed\") " pod="openshift-ingress/e2e-mt-37fb922a-openshift-default-c654c65f-94rgb" Jul 11 01:43:14.328356 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:14.328306 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92657f17-c9fe-44c7-a3f7-63e301e100ed-istio-envoy\") pod \"e2e-mt-37fb922a-openshift-default-c654c65f-94rgb\" (UID: \"92657f17-c9fe-44c7-a3f7-63e301e100ed\") " pod="openshift-ingress/e2e-mt-37fb922a-openshift-default-c654c65f-94rgb" Jul 11 01:43:14.328356 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:14.328370 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92657f17-c9fe-44c7-a3f7-63e301e100ed-istiod-ca-cert\") pod \"e2e-mt-37fb922a-openshift-default-c654c65f-94rgb\" (UID: \"92657f17-c9fe-44c7-a3f7-63e301e100ed\") " pod="openshift-ingress/e2e-mt-37fb922a-openshift-default-c654c65f-94rgb" Jul 11 01:43:14.328641 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:14.328395 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92657f17-c9fe-44c7-a3f7-63e301e100ed-credential-socket\") pod \"e2e-mt-37fb922a-openshift-default-c654c65f-94rgb\" (UID: \"92657f17-c9fe-44c7-a3f7-63e301e100ed\") " pod="openshift-ingress/e2e-mt-37fb922a-openshift-default-c654c65f-94rgb" Jul 11 01:43:14.328641 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:14.328419 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92657f17-c9fe-44c7-a3f7-63e301e100ed-workload-socket\") pod \"e2e-mt-37fb922a-openshift-default-c654c65f-94rgb\" (UID: \"92657f17-c9fe-44c7-a3f7-63e301e100ed\") " pod="openshift-ingress/e2e-mt-37fb922a-openshift-default-c654c65f-94rgb" Jul 11 01:43:14.328641 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:14.328442 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92657f17-c9fe-44c7-a3f7-63e301e100ed-istio-data\") pod \"e2e-mt-37fb922a-openshift-default-c654c65f-94rgb\" (UID: \"92657f17-c9fe-44c7-a3f7-63e301e100ed\") " pod="openshift-ingress/e2e-mt-37fb922a-openshift-default-c654c65f-94rgb" Jul 11 01:43:14.328641 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:14.328469 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92657f17-c9fe-44c7-a3f7-63e301e100ed-istio-podinfo\") pod \"e2e-mt-37fb922a-openshift-default-c654c65f-94rgb\" (UID: \"92657f17-c9fe-44c7-a3f7-63e301e100ed\") " pod="openshift-ingress/e2e-mt-37fb922a-openshift-default-c654c65f-94rgb" Jul 11 01:43:14.328641 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:14.328550 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtfrc\" (UniqueName: \"kubernetes.io/projected/92657f17-c9fe-44c7-a3f7-63e301e100ed-kube-api-access-vtfrc\") pod \"e2e-mt-37fb922a-openshift-default-c654c65f-94rgb\" (UID: \"92657f17-c9fe-44c7-a3f7-63e301e100ed\") " pod="openshift-ingress/e2e-mt-37fb922a-openshift-default-c654c65f-94rgb" Jul 11 01:43:14.328641 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:14.328588 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92657f17-c9fe-44c7-a3f7-63e301e100ed-workload-certs\") pod \"e2e-mt-37fb922a-openshift-default-c654c65f-94rgb\" (UID: \"92657f17-c9fe-44c7-a3f7-63e301e100ed\") " pod="openshift-ingress/e2e-mt-37fb922a-openshift-default-c654c65f-94rgb" Jul 11 01:43:14.328641 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:14.328642 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92657f17-c9fe-44c7-a3f7-63e301e100ed-istio-token\") pod \"e2e-mt-37fb922a-openshift-default-c654c65f-94rgb\" (UID: \"92657f17-c9fe-44c7-a3f7-63e301e100ed\") " pod="openshift-ingress/e2e-mt-37fb922a-openshift-default-c654c65f-94rgb" Jul 11 01:43:14.329042 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:14.328877 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92657f17-c9fe-44c7-a3f7-63e301e100ed-credential-socket\") pod \"e2e-mt-37fb922a-openshift-default-c654c65f-94rgb\" (UID: \"92657f17-c9fe-44c7-a3f7-63e301e100ed\") " pod="openshift-ingress/e2e-mt-37fb922a-openshift-default-c654c65f-94rgb" Jul 11 01:43:14.329042 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:14.328906 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92657f17-c9fe-44c7-a3f7-63e301e100ed-istio-data\") pod \"e2e-mt-37fb922a-openshift-default-c654c65f-94rgb\" (UID: \"92657f17-c9fe-44c7-a3f7-63e301e100ed\") " pod="openshift-ingress/e2e-mt-37fb922a-openshift-default-c654c65f-94rgb" Jul 11 01:43:14.329042 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:14.328940 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92657f17-c9fe-44c7-a3f7-63e301e100ed-workload-socket\") pod \"e2e-mt-37fb922a-openshift-default-c654c65f-94rgb\" (UID: \"92657f17-c9fe-44c7-a3f7-63e301e100ed\") " pod="openshift-ingress/e2e-mt-37fb922a-openshift-default-c654c65f-94rgb" Jul 11 01:43:14.329259 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:14.329160 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92657f17-c9fe-44c7-a3f7-63e301e100ed-workload-certs\") pod \"e2e-mt-37fb922a-openshift-default-c654c65f-94rgb\" (UID: \"92657f17-c9fe-44c7-a3f7-63e301e100ed\") " pod="openshift-ingress/e2e-mt-37fb922a-openshift-default-c654c65f-94rgb" Jul 11 01:43:14.329575 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:14.329553 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92657f17-c9fe-44c7-a3f7-63e301e100ed-istiod-ca-cert\") pod \"e2e-mt-37fb922a-openshift-default-c654c65f-94rgb\" (UID: \"92657f17-c9fe-44c7-a3f7-63e301e100ed\") " pod="openshift-ingress/e2e-mt-37fb922a-openshift-default-c654c65f-94rgb" Jul 11 01:43:14.330709 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:14.330678 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92657f17-c9fe-44c7-a3f7-63e301e100ed-istio-envoy\") pod \"e2e-mt-37fb922a-openshift-default-c654c65f-94rgb\" (UID: \"92657f17-c9fe-44c7-a3f7-63e301e100ed\") " pod="openshift-ingress/e2e-mt-37fb922a-openshift-default-c654c65f-94rgb" Jul 11 01:43:14.331008 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:14.330989 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92657f17-c9fe-44c7-a3f7-63e301e100ed-istio-podinfo\") pod \"e2e-mt-37fb922a-openshift-default-c654c65f-94rgb\" (UID: \"92657f17-c9fe-44c7-a3f7-63e301e100ed\") " pod="openshift-ingress/e2e-mt-37fb922a-openshift-default-c654c65f-94rgb" Jul 11 01:43:14.336248 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:14.336227 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92657f17-c9fe-44c7-a3f7-63e301e100ed-istio-token\") pod \"e2e-mt-37fb922a-openshift-default-c654c65f-94rgb\" (UID: \"92657f17-c9fe-44c7-a3f7-63e301e100ed\") " pod="openshift-ingress/e2e-mt-37fb922a-openshift-default-c654c65f-94rgb" Jul 11 01:43:14.336421 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:14.336401 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtfrc\" (UniqueName: \"kubernetes.io/projected/92657f17-c9fe-44c7-a3f7-63e301e100ed-kube-api-access-vtfrc\") pod \"e2e-mt-37fb922a-openshift-default-c654c65f-94rgb\" (UID: \"92657f17-c9fe-44c7-a3f7-63e301e100ed\") " pod="openshift-ingress/e2e-mt-37fb922a-openshift-default-c654c65f-94rgb" Jul 11 01:43:14.447622 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:14.447591 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-37fb922a-openshift-default-c654c65f-94rgb" Jul 11 01:43:14.595277 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:43:14.595239 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92657f17_c9fe_44c7_a3f7_63e301e100ed.slice/crio-b2b9ecf083d5d3a6d7fc69938983c7f2219ea45614fd19bb43adc37e32873b59 WatchSource:0}: Error finding container b2b9ecf083d5d3a6d7fc69938983c7f2219ea45614fd19bb43adc37e32873b59: Status 404 returned error can't find the container with id b2b9ecf083d5d3a6d7fc69938983c7f2219ea45614fd19bb43adc37e32873b59 Jul 11 01:43:14.596543 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:14.596517 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-37fb922a-openshift-default-c654c65f-94rgb"] Jul 11 01:43:14.597414 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:14.597381 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:43:14.597499 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:14.597459 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:43:14.597499 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:14.597489 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:43:14.847534 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:14.847441 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-37fb922a-openshift-default-c654c65f-94rgb" event={"ID":"92657f17-c9fe-44c7-a3f7-63e301e100ed","Type":"ContainerStarted","Data":"711b232df4dd02b58f0010ccc1444f85458b1674cd1af82013f6937c78b39586"} Jul 11 01:43:14.847534 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:14.847493 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-37fb922a-openshift-default-c654c65f-94rgb" event={"ID":"92657f17-c9fe-44c7-a3f7-63e301e100ed","Type":"ContainerStarted","Data":"b2b9ecf083d5d3a6d7fc69938983c7f2219ea45614fd19bb43adc37e32873b59"} Jul 11 01:43:14.865447 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:14.865387 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-37fb922a-openshift-default-c654c65f-94rgb" podStartSLOduration=0.865368195 podStartE2EDuration="865.368195ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:43:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:43:14.864734856 +0000 UTC m=+2199.196210432" watchObservedRunningTime="2026-07-11 01:43:14.865368195 +0000 UTC m=+2199.196843739" Jul 11 01:43:15.448225 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:15.448184 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-37fb922a-openshift-default-c654c65f-94rgb" Jul 11 01:43:15.453417 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:15.453391 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-37fb922a-openshift-default-c654c65f-94rgb" Jul 11 01:43:15.851113 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:15.851033 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-37fb922a-openshift-default-c654c65f-94rgb" Jul 11 01:43:15.852004 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:15.851989 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-37fb922a-openshift-default-c654c65f-94rgb" Jul 11 01:43:29.910385 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:29.910301 2572 generic.go:356] "Generic (PLEG): container finished" podID="92657f17-c9fe-44c7-a3f7-63e301e100ed" containerID="711b232df4dd02b58f0010ccc1444f85458b1674cd1af82013f6937c78b39586" exitCode=0 Jul 11 01:43:29.910385 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:29.910357 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-37fb922a-openshift-default-c654c65f-94rgb" event={"ID":"92657f17-c9fe-44c7-a3f7-63e301e100ed","Type":"ContainerDied","Data":"711b232df4dd02b58f0010ccc1444f85458b1674cd1af82013f6937c78b39586"} Jul 11 01:43:29.910843 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:29.910765 2572 scope.go:117] "RemoveContainer" containerID="711b232df4dd02b58f0010ccc1444f85458b1674cd1af82013f6937c78b39586" Jul 11 01:43:29.913995 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:29.913947 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:43:29.914093 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:29.914032 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:43:29.914093 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:29.914069 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:43:30.851893 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:30.851823 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-37fb922a-openshift-default-c654c65f-94rgb" Jul 11 01:43:30.916908 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:30.916872 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-37fb922a-openshift-default-c654c65f-94rgb" event={"ID":"92657f17-c9fe-44c7-a3f7-63e301e100ed","Type":"ContainerStarted","Data":"fb027afd6a2a5e7019b5e461de8c6bdc282d5a27b655e0f3d28a988bd000e00c"} Jul 11 01:43:31.448020 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:31.447973 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-37fb922a-openshift-default-c654c65f-94rgb" Jul 11 01:43:31.449179 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:31.449141 2572 patch_prober.go:28] interesting pod/e2e-mt-37fb922a-openshift-default-c654c65f-94rgb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body= Jul 11 01:43:31.449314 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:31.449219 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-37fb922a-openshift-default-c654c65f-94rgb" podUID="92657f17-c9fe-44c7-a3f7-63e301e100ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" Jul 11 01:43:32.448233 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:32.448186 2572 patch_prober.go:28] interesting pod/e2e-mt-37fb922a-openshift-default-c654c65f-94rgb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body= Jul 11 01:43:32.448739 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:32.448258 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-37fb922a-openshift-default-c654c65f-94rgb" podUID="92657f17-c9fe-44c7-a3f7-63e301e100ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" Jul 11 01:43:33.448857 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:33.448812 2572 patch_prober.go:28] interesting pod/e2e-mt-37fb922a-openshift-default-c654c65f-94rgb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body= Jul 11 01:43:33.449349 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:33.448884 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-37fb922a-openshift-default-c654c65f-94rgb" podUID="92657f17-c9fe-44c7-a3f7-63e301e100ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" Jul 11 01:43:34.448265 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:34.448212 2572 patch_prober.go:28] interesting pod/e2e-mt-37fb922a-openshift-default-c654c65f-94rgb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body= Jul 11 01:43:34.448476 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:34.448287 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-37fb922a-openshift-default-c654c65f-94rgb" podUID="92657f17-c9fe-44c7-a3f7-63e301e100ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" Jul 11 01:43:35.452869 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:35.452828 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-37fb922a-openshift-default-c654c65f-94rgb" Jul 11 01:43:35.453405 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:35.453128 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-37fb922a-openshift-default-c654c65f-94rgb" Jul 11 01:43:35.453836 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:35.453814 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-37fb922a-openshift-default-c654c65f-94rgb" Jul 11 01:43:54.054068 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:54.054034 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-37fb922a-openshift-default-c654c65f-94rgb"] Jul 11 01:43:54.054687 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:54.054272 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-37fb922a-openshift-default-c654c65f-94rgb" podUID="92657f17-c9fe-44c7-a3f7-63e301e100ed" containerName="istio-proxy" containerID="cri-o://fb027afd6a2a5e7019b5e461de8c6bdc282d5a27b655e0f3d28a988bd000e00c" gracePeriod=30 Jul 11 01:43:59.299772 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:59.299744 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-37fb922a-openshift-default-c654c65f-94rgb" Jul 11 01:43:59.331611 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:59.331511 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92657f17-c9fe-44c7-a3f7-63e301e100ed-istio-envoy\") pod \"92657f17-c9fe-44c7-a3f7-63e301e100ed\" (UID: \"92657f17-c9fe-44c7-a3f7-63e301e100ed\") " Jul 11 01:43:59.331611 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:59.331547 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92657f17-c9fe-44c7-a3f7-63e301e100ed-credential-socket\") pod \"92657f17-c9fe-44c7-a3f7-63e301e100ed\" (UID: \"92657f17-c9fe-44c7-a3f7-63e301e100ed\") " Jul 11 01:43:59.331611 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:59.331584 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92657f17-c9fe-44c7-a3f7-63e301e100ed-workload-socket\") pod \"92657f17-c9fe-44c7-a3f7-63e301e100ed\" (UID: \"92657f17-c9fe-44c7-a3f7-63e301e100ed\") " Jul 11 01:43:59.331611 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:59.331604 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92657f17-c9fe-44c7-a3f7-63e301e100ed-istio-data\") pod \"92657f17-c9fe-44c7-a3f7-63e301e100ed\" (UID: \"92657f17-c9fe-44c7-a3f7-63e301e100ed\") " Jul 11 01:43:59.331985 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:59.331624 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92657f17-c9fe-44c7-a3f7-63e301e100ed-istiod-ca-cert\") pod \"92657f17-c9fe-44c7-a3f7-63e301e100ed\" (UID: \"92657f17-c9fe-44c7-a3f7-63e301e100ed\") " Jul 11 01:43:59.331985 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:59.331651 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92657f17-c9fe-44c7-a3f7-63e301e100ed-workload-certs\") pod \"92657f17-c9fe-44c7-a3f7-63e301e100ed\" (UID: \"92657f17-c9fe-44c7-a3f7-63e301e100ed\") " Jul 11 01:43:59.331985 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:59.331711 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92657f17-c9fe-44c7-a3f7-63e301e100ed-istio-podinfo\") pod \"92657f17-c9fe-44c7-a3f7-63e301e100ed\" (UID: \"92657f17-c9fe-44c7-a3f7-63e301e100ed\") " Jul 11 01:43:59.331985 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:59.331734 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92657f17-c9fe-44c7-a3f7-63e301e100ed-istio-token\") pod \"92657f17-c9fe-44c7-a3f7-63e301e100ed\" (UID: \"92657f17-c9fe-44c7-a3f7-63e301e100ed\") " Jul 11 01:43:59.331985 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:59.331782 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vtfrc\" (UniqueName: \"kubernetes.io/projected/92657f17-c9fe-44c7-a3f7-63e301e100ed-kube-api-access-vtfrc\") pod \"92657f17-c9fe-44c7-a3f7-63e301e100ed\" (UID: \"92657f17-c9fe-44c7-a3f7-63e301e100ed\") " Jul 11 01:43:59.331985 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:59.331874 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92657f17-c9fe-44c7-a3f7-63e301e100ed-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "92657f17-c9fe-44c7-a3f7-63e301e100ed" (UID: "92657f17-c9fe-44c7-a3f7-63e301e100ed"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 01:43:59.332296 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:59.332011 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92657f17-c9fe-44c7-a3f7-63e301e100ed-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "92657f17-c9fe-44c7-a3f7-63e301e100ed" (UID: "92657f17-c9fe-44c7-a3f7-63e301e100ed"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 01:43:59.332296 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:59.332044 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92657f17-c9fe-44c7-a3f7-63e301e100ed-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "92657f17-c9fe-44c7-a3f7-63e301e100ed" (UID: "92657f17-c9fe-44c7-a3f7-63e301e100ed"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 11 01:43:59.332296 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:59.332108 2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92657f17-c9fe-44c7-a3f7-63e301e100ed-workload-socket\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:43:59.332296 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:59.332126 2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92657f17-c9fe-44c7-a3f7-63e301e100ed-workload-certs\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:43:59.332499 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:59.332327 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92657f17-c9fe-44c7-a3f7-63e301e100ed-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "92657f17-c9fe-44c7-a3f7-63e301e100ed" (UID: "92657f17-c9fe-44c7-a3f7-63e301e100ed"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 01:43:59.332499 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:59.332486 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92657f17-c9fe-44c7-a3f7-63e301e100ed-istio-data" (OuterVolumeSpecName: "istio-data") pod "92657f17-c9fe-44c7-a3f7-63e301e100ed" (UID: "92657f17-c9fe-44c7-a3f7-63e301e100ed"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 01:43:59.334034 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:59.334001 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92657f17-c9fe-44c7-a3f7-63e301e100ed-kube-api-access-vtfrc" (OuterVolumeSpecName: "kube-api-access-vtfrc") pod "92657f17-c9fe-44c7-a3f7-63e301e100ed" (UID: "92657f17-c9fe-44c7-a3f7-63e301e100ed"). InnerVolumeSpecName "kube-api-access-vtfrc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 11 01:43:59.334148 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:59.334072 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/92657f17-c9fe-44c7-a3f7-63e301e100ed-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "92657f17-c9fe-44c7-a3f7-63e301e100ed" (UID: "92657f17-c9fe-44c7-a3f7-63e301e100ed"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 11 01:43:59.334422 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:59.334401 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92657f17-c9fe-44c7-a3f7-63e301e100ed-istio-token" (OuterVolumeSpecName: "istio-token") pod "92657f17-c9fe-44c7-a3f7-63e301e100ed" (UID: "92657f17-c9fe-44c7-a3f7-63e301e100ed"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 11 01:43:59.334422 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:59.334411 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92657f17-c9fe-44c7-a3f7-63e301e100ed-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "92657f17-c9fe-44c7-a3f7-63e301e100ed" (UID: "92657f17-c9fe-44c7-a3f7-63e301e100ed"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 01:43:59.432875 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:59.432837 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vtfrc\" (UniqueName: \"kubernetes.io/projected/92657f17-c9fe-44c7-a3f7-63e301e100ed-kube-api-access-vtfrc\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:43:59.432875 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:59.432865 2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92657f17-c9fe-44c7-a3f7-63e301e100ed-istio-envoy\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:43:59.432875 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:59.432874 2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92657f17-c9fe-44c7-a3f7-63e301e100ed-credential-socket\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:43:59.432875 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:59.432884 2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92657f17-c9fe-44c7-a3f7-63e301e100ed-istio-data\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:43:59.433131 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:59.432893 2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92657f17-c9fe-44c7-a3f7-63e301e100ed-istiod-ca-cert\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:43:59.433131 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:59.432901 2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92657f17-c9fe-44c7-a3f7-63e301e100ed-istio-podinfo\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:43:59.433131 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:43:59.432909 2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92657f17-c9fe-44c7-a3f7-63e301e100ed-istio-token\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:44:00.036563 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:44:00.036523 2572 generic.go:356] "Generic (PLEG): container finished" podID="92657f17-c9fe-44c7-a3f7-63e301e100ed" containerID="fb027afd6a2a5e7019b5e461de8c6bdc282d5a27b655e0f3d28a988bd000e00c" exitCode=0 Jul 11 01:44:00.036821 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:44:00.036576 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-37fb922a-openshift-default-c654c65f-94rgb" Jul 11 01:44:00.036821 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:44:00.036599 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-37fb922a-openshift-default-c654c65f-94rgb" event={"ID":"92657f17-c9fe-44c7-a3f7-63e301e100ed","Type":"ContainerDied","Data":"fb027afd6a2a5e7019b5e461de8c6bdc282d5a27b655e0f3d28a988bd000e00c"} Jul 11 01:44:00.036821 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:44:00.036652 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-37fb922a-openshift-default-c654c65f-94rgb" event={"ID":"92657f17-c9fe-44c7-a3f7-63e301e100ed","Type":"ContainerDied","Data":"b2b9ecf083d5d3a6d7fc69938983c7f2219ea45614fd19bb43adc37e32873b59"} Jul 11 01:44:00.036821 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:44:00.036688 2572 scope.go:117] "RemoveContainer" containerID="fb027afd6a2a5e7019b5e461de8c6bdc282d5a27b655e0f3d28a988bd000e00c" Jul 11 01:44:00.045292 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:44:00.045272 2572 scope.go:117] "RemoveContainer" containerID="711b232df4dd02b58f0010ccc1444f85458b1674cd1af82013f6937c78b39586" Jul 11 01:44:00.053147 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:44:00.053131 2572 scope.go:117] "RemoveContainer" containerID="fb027afd6a2a5e7019b5e461de8c6bdc282d5a27b655e0f3d28a988bd000e00c" Jul 11 01:44:00.053412 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:44:00.053383 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb027afd6a2a5e7019b5e461de8c6bdc282d5a27b655e0f3d28a988bd000e00c\": container with ID starting with fb027afd6a2a5e7019b5e461de8c6bdc282d5a27b655e0f3d28a988bd000e00c not found: ID does not exist" containerID="fb027afd6a2a5e7019b5e461de8c6bdc282d5a27b655e0f3d28a988bd000e00c" Jul 11 01:44:00.053479 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:44:00.053407 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb027afd6a2a5e7019b5e461de8c6bdc282d5a27b655e0f3d28a988bd000e00c"} err="failed to get container status \"fb027afd6a2a5e7019b5e461de8c6bdc282d5a27b655e0f3d28a988bd000e00c\": rpc error: code = NotFound desc = could not find container \"fb027afd6a2a5e7019b5e461de8c6bdc282d5a27b655e0f3d28a988bd000e00c\": container with ID starting with fb027afd6a2a5e7019b5e461de8c6bdc282d5a27b655e0f3d28a988bd000e00c not found: ID does not exist" Jul 11 01:44:00.053479 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:44:00.053425 2572 scope.go:117] "RemoveContainer" containerID="711b232df4dd02b58f0010ccc1444f85458b1674cd1af82013f6937c78b39586" Jul 11 01:44:00.053680 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:44:00.053661 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"711b232df4dd02b58f0010ccc1444f85458b1674cd1af82013f6937c78b39586\": container with ID starting with 711b232df4dd02b58f0010ccc1444f85458b1674cd1af82013f6937c78b39586 not found: ID does not exist" containerID="711b232df4dd02b58f0010ccc1444f85458b1674cd1af82013f6937c78b39586" Jul 11 01:44:00.053741 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:44:00.053687 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"711b232df4dd02b58f0010ccc1444f85458b1674cd1af82013f6937c78b39586"} err="failed to get container status \"711b232df4dd02b58f0010ccc1444f85458b1674cd1af82013f6937c78b39586\": rpc error: code = NotFound desc = could not find container \"711b232df4dd02b58f0010ccc1444f85458b1674cd1af82013f6937c78b39586\": container with ID starting with 711b232df4dd02b58f0010ccc1444f85458b1674cd1af82013f6937c78b39586 not found: ID does not exist" Jul 11 01:44:00.057165 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:44:00.057143 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-37fb922a-openshift-default-c654c65f-94rgb"] Jul 11 01:44:00.060412 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:44:00.060392 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-37fb922a-openshift-default-c654c65f-94rgb"] Jul 11 01:44:00.256929 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:44:00.256888 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92657f17-c9fe-44c7-a3f7-63e301e100ed" path="/var/lib/kubelet/pods/92657f17-c9fe-44c7-a3f7-63e301e100ed/volumes" Jul 11 01:44:13.716047 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:44:13.716014 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp"] Jul 11 01:44:13.716773 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:44:13.716345 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="711dfe7a-5ca8-4ada-9143-c19de6f91a63" containerName="istio-proxy" Jul 11 01:44:13.716773 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:44:13.716357 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="711dfe7a-5ca8-4ada-9143-c19de6f91a63" containerName="istio-proxy" Jul 11 01:44:13.716773 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:44:13.716373 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92657f17-c9fe-44c7-a3f7-63e301e100ed" containerName="istio-proxy" Jul 11 01:44:13.716773 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:44:13.716379 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="92657f17-c9fe-44c7-a3f7-63e301e100ed" containerName="istio-proxy" Jul 11 01:44:13.716773 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:44:13.716425 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="92657f17-c9fe-44c7-a3f7-63e301e100ed" containerName="istio-proxy" Jul 11 01:44:13.716773 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:44:13.716433 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="a36eb288-d6c3-47e1-9dc6-c7d9af7afa30" containerName="istio-proxy" Jul 11 01:44:13.719239 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:44:13.719217 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp" Jul 11 01:44:13.721668 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:44:13.721642 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-83b6ef8d-openshift-default-dockercfg-7gp2g\"" Jul 11 01:44:13.733115 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:44:13.733078 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp"] Jul 11 01:44:13.863568 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:44:13.863524 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/301d77ec-de77-49a0-a248-2d18119ab0d1-workload-socket\") pod \"e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp\" (UID: \"301d77ec-de77-49a0-a248-2d18119ab0d1\") " pod="openshift-ingress/e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp" Jul 11 01:44:13.863757 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:44:13.863590 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/301d77ec-de77-49a0-a248-2d18119ab0d1-istio-token\") pod \"e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp\" (UID: \"301d77ec-de77-49a0-a248-2d18119ab0d1\") " pod="openshift-ingress/e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp" Jul 11 01:44:13.863757 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:44:13.863678 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/301d77ec-de77-49a0-a248-2d18119ab0d1-workload-certs\") pod \"e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp\" (UID: \"301d77ec-de77-49a0-a248-2d18119ab0d1\") " pod="openshift-ingress/e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp" Jul 11 01:44:13.863833 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:44:13.863757 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/301d77ec-de77-49a0-a248-2d18119ab0d1-istiod-ca-cert\") pod \"e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp\" (UID: \"301d77ec-de77-49a0-a248-2d18119ab0d1\") " pod="openshift-ingress/e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp" Jul 11 01:44:13.863833 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:44:13.863791 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/301d77ec-de77-49a0-a248-2d18119ab0d1-credential-socket\") pod \"e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp\" (UID: \"301d77ec-de77-49a0-a248-2d18119ab0d1\") " pod="openshift-ingress/e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp" Jul 11 01:44:13.863833 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:44:13.863812 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/301d77ec-de77-49a0-a248-2d18119ab0d1-istio-envoy\") pod \"e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp\" (UID: \"301d77ec-de77-49a0-a248-2d18119ab0d1\") " pod="openshift-ingress/e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp" Jul 11 01:44:13.863936 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:44:13.863845 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5s4d\" (UniqueName: \"kubernetes.io/projected/301d77ec-de77-49a0-a248-2d18119ab0d1-kube-api-access-g5s4d\") pod \"e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp\" (UID: \"301d77ec-de77-49a0-a248-2d18119ab0d1\") " pod="openshift-ingress/e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp" Jul 11 01:44:13.863936 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:44:13.863869 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/301d77ec-de77-49a0-a248-2d18119ab0d1-istio-data\") pod \"e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp\" (UID: \"301d77ec-de77-49a0-a248-2d18119ab0d1\") " pod="openshift-ingress/e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp" Jul 11 01:44:13.863936 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:44:13.863913 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/301d77ec-de77-49a0-a248-2d18119ab0d1-istio-podinfo\") pod \"e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp\" (UID: \"301d77ec-de77-49a0-a248-2d18119ab0d1\") " pod="openshift-ingress/e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp" Jul 11 01:44:13.964458 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:44:13.964414 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/301d77ec-de77-49a0-a248-2d18119ab0d1-istio-token\") pod \"e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp\" (UID: \"301d77ec-de77-49a0-a248-2d18119ab0d1\") " pod="openshift-ingress/e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp" Jul 11 01:44:13.964458 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:44:13.964463 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/301d77ec-de77-49a0-a248-2d18119ab0d1-workload-certs\") pod \"e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp\" (UID: \"301d77ec-de77-49a0-a248-2d18119ab0d1\") " pod="openshift-ingress/e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp" Jul 11 01:44:13.964765 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:44:13.964484 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/301d77ec-de77-49a0-a248-2d18119ab0d1-istiod-ca-cert\") pod \"e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp\" (UID: \"301d77ec-de77-49a0-a248-2d18119ab0d1\") " pod="openshift-ingress/e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp" Jul 11 01:44:13.964765 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:44:13.964511 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/301d77ec-de77-49a0-a248-2d18119ab0d1-credential-socket\") pod \"e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp\" (UID: \"301d77ec-de77-49a0-a248-2d18119ab0d1\") " pod="openshift-ingress/e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp" Jul 11 01:44:13.964765 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:44:13.964529 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/301d77ec-de77-49a0-a248-2d18119ab0d1-istio-envoy\") pod \"e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp\" (UID: \"301d77ec-de77-49a0-a248-2d18119ab0d1\") " pod="openshift-ingress/e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp" Jul 11 01:44:13.964765 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:44:13.964571 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5s4d\" (UniqueName: \"kubernetes.io/projected/301d77ec-de77-49a0-a248-2d18119ab0d1-kube-api-access-g5s4d\") pod \"e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp\" (UID: \"301d77ec-de77-49a0-a248-2d18119ab0d1\") " pod="openshift-ingress/e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp" Jul 11 01:44:13.964765 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:44:13.964597 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/301d77ec-de77-49a0-a248-2d18119ab0d1-istio-data\") pod \"e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp\" (UID: \"301d77ec-de77-49a0-a248-2d18119ab0d1\") " pod="openshift-ingress/e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp" Jul 11 01:44:13.964765 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:44:13.964643 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/301d77ec-de77-49a0-a248-2d18119ab0d1-istio-podinfo\") pod \"e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp\" (UID: \"301d77ec-de77-49a0-a248-2d18119ab0d1\") " pod="openshift-ingress/e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp" Jul 11 01:44:13.964765 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:44:13.964686 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/301d77ec-de77-49a0-a248-2d18119ab0d1-workload-socket\") pod \"e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp\" (UID: \"301d77ec-de77-49a0-a248-2d18119ab0d1\") " pod="openshift-ingress/e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp" Jul 11 01:44:13.965303 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:44:13.965277 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/301d77ec-de77-49a0-a248-2d18119ab0d1-workload-certs\") pod \"e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp\" (UID: \"301d77ec-de77-49a0-a248-2d18119ab0d1\") " pod="openshift-ingress/e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp" Jul 11 01:44:13.965392 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:44:13.965358 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/301d77ec-de77-49a0-a248-2d18119ab0d1-istio-data\") pod \"e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp\" (UID: \"301d77ec-de77-49a0-a248-2d18119ab0d1\") " pod="openshift-ingress/e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp" Jul 11 01:44:13.965392 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:44:13.965374 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/301d77ec-de77-49a0-a248-2d18119ab0d1-credential-socket\") pod \"e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp\" (UID: \"301d77ec-de77-49a0-a248-2d18119ab0d1\") " pod="openshift-ingress/e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp" Jul 11 01:44:13.965541 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:44:13.965521 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/301d77ec-de77-49a0-a248-2d18119ab0d1-workload-socket\") pod \"e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp\" (UID: \"301d77ec-de77-49a0-a248-2d18119ab0d1\") " pod="openshift-ingress/e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp" Jul 11 01:44:13.965762 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:44:13.965686 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/301d77ec-de77-49a0-a248-2d18119ab0d1-istiod-ca-cert\") pod \"e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp\" (UID: \"301d77ec-de77-49a0-a248-2d18119ab0d1\") " pod="openshift-ingress/e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp" Jul 11 01:44:13.971088 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:44:13.968072 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/301d77ec-de77-49a0-a248-2d18119ab0d1-istio-envoy\") pod \"e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp\" (UID: \"301d77ec-de77-49a0-a248-2d18119ab0d1\") " pod="openshift-ingress/e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp" Jul 11 01:44:13.972137 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:44:13.972112 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/301d77ec-de77-49a0-a248-2d18119ab0d1-istio-podinfo\") pod \"e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp\" (UID: \"301d77ec-de77-49a0-a248-2d18119ab0d1\") " pod="openshift-ingress/e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp" Jul 11 01:44:13.973086 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:44:13.973067 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/301d77ec-de77-49a0-a248-2d18119ab0d1-istio-token\") pod \"e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp\" (UID: \"301d77ec-de77-49a0-a248-2d18119ab0d1\") " pod="openshift-ingress/e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp" Jul 11 01:44:13.979350 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:44:13.979328 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5s4d\" (UniqueName: \"kubernetes.io/projected/301d77ec-de77-49a0-a248-2d18119ab0d1-kube-api-access-g5s4d\") pod \"e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp\" (UID: \"301d77ec-de77-49a0-a248-2d18119ab0d1\") " pod="openshift-ingress/e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp" Jul 11 01:44:14.030343 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:44:14.030295 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp" Jul 11 01:44:14.167445 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:44:14.167420 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp"] Jul 11 01:44:14.169393 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:44:14.169369 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod301d77ec_de77_49a0_a248_2d18119ab0d1.slice/crio-028c1664620a49ee88ae9752ee2aa1012b26b58ee9e240f229d275b838fa17de WatchSource:0}: Error finding container 028c1664620a49ee88ae9752ee2aa1012b26b58ee9e240f229d275b838fa17de: Status 404 returned error can't find the container with id 028c1664620a49ee88ae9752ee2aa1012b26b58ee9e240f229d275b838fa17de Jul 11 01:44:14.171411 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:44:14.171381 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:44:14.171459 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:44:14.171447 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:44:14.171497 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:44:14.171475 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:44:15.105014 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:44:15.104968 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp" event={"ID":"301d77ec-de77-49a0-a248-2d18119ab0d1","Type":"ContainerStarted","Data":"768a452b46fd69b99f2f076b04d802a1763f40682ffee585c7e85c0e4a5b0941"} Jul 11 01:44:15.105402 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:44:15.105031 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp" event={"ID":"301d77ec-de77-49a0-a248-2d18119ab0d1","Type":"ContainerStarted","Data":"028c1664620a49ee88ae9752ee2aa1012b26b58ee9e240f229d275b838fa17de"} Jul 11 01:44:16.031014 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:44:16.030978 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp" Jul 11 01:44:16.035852 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:44:16.035827 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp" Jul 11 01:44:16.055539 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:44:16.055493 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp" podStartSLOduration=3.055477165 podStartE2EDuration="3.055477165s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:44:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:44:15.123732466 +0000 UTC m=+2259.455208031" watchObservedRunningTime="2026-07-11 01:44:16.055477165 +0000 UTC m=+2260.386952709" Jul 11 01:44:16.109455 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:44:16.109425 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp" Jul 11 01:44:16.110394 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:44:16.110376 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp" Jul 11 01:44:30.182756 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:44:30.182634 2572 generic.go:356] "Generic (PLEG): container finished" podID="301d77ec-de77-49a0-a248-2d18119ab0d1" containerID="768a452b46fd69b99f2f076b04d802a1763f40682ffee585c7e85c0e4a5b0941" exitCode=0 Jul 11 01:44:30.182756 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:44:30.182677 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp" event={"ID":"301d77ec-de77-49a0-a248-2d18119ab0d1","Type":"ContainerDied","Data":"768a452b46fd69b99f2f076b04d802a1763f40682ffee585c7e85c0e4a5b0941"} Jul 11 01:44:30.183163 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:44:30.183075 2572 scope.go:117] "RemoveContainer" containerID="768a452b46fd69b99f2f076b04d802a1763f40682ffee585c7e85c0e4a5b0941" Jul 11 01:44:30.184075 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:44:30.184045 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:44:30.184147 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:44:30.184129 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:44:30.184198 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:44:30.184183 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:44:31.109747 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:44:31.109694 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp" Jul 11 01:44:31.188568 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:44:31.188535 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp" event={"ID":"301d77ec-de77-49a0-a248-2d18119ab0d1","Type":"ContainerStarted","Data":"f0eb287f49e94a42ca34970bd7eb50304a512cbd687e36b9e89b70554ee970c3"} Jul 11 01:44:32.030983 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:44:32.030942 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp" Jul 11 01:44:32.032074 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:44:32.032043 2572 patch_prober.go:28] interesting pod/e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body= Jul 11 01:44:32.032316 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:44:32.032287 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp" podUID="301d77ec-de77-49a0-a248-2d18119ab0d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" Jul 11 01:44:33.031093 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:44:33.031053 2572 patch_prober.go:28] interesting pod/e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body= Jul 11 01:44:33.031481 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:44:33.031122 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp" podUID="301d77ec-de77-49a0-a248-2d18119ab0d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" Jul 11 01:44:34.031116 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:44:34.031074 2572 patch_prober.go:28] interesting pod/e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body= Jul 11 01:44:34.031505 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:44:34.031130 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp" podUID="301d77ec-de77-49a0-a248-2d18119ab0d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" Jul 11 01:44:35.038089 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:44:35.038057 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp" Jul 11 01:44:35.038545 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:44:35.038436 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp" Jul 11 01:44:35.039190 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:44:35.039168 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp" Jul 11 01:45:56.813650 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:45:56.813564 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp"] Jul 11 01:45:56.814135 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:45:56.813789 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp" podUID="301d77ec-de77-49a0-a248-2d18119ab0d1" containerName="istio-proxy" containerID="cri-o://f0eb287f49e94a42ca34970bd7eb50304a512cbd687e36b9e89b70554ee970c3" gracePeriod=30 Jul 11 01:46:02.067793 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:02.067760 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp" Jul 11 01:46:02.230099 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:02.230063 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/301d77ec-de77-49a0-a248-2d18119ab0d1-workload-certs\") pod \"301d77ec-de77-49a0-a248-2d18119ab0d1\" (UID: \"301d77ec-de77-49a0-a248-2d18119ab0d1\") " Jul 11 01:46:02.230309 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:02.230125 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/301d77ec-de77-49a0-a248-2d18119ab0d1-istio-envoy\") pod \"301d77ec-de77-49a0-a248-2d18119ab0d1\" (UID: \"301d77ec-de77-49a0-a248-2d18119ab0d1\") " Jul 11 01:46:02.230309 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:02.230213 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/301d77ec-de77-49a0-a248-2d18119ab0d1-istio-data\") pod \"301d77ec-de77-49a0-a248-2d18119ab0d1\" (UID: \"301d77ec-de77-49a0-a248-2d18119ab0d1\") " Jul 11 01:46:02.230309 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:02.230254 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/301d77ec-de77-49a0-a248-2d18119ab0d1-istio-podinfo\") pod \"301d77ec-de77-49a0-a248-2d18119ab0d1\" (UID: \"301d77ec-de77-49a0-a248-2d18119ab0d1\") " Jul 11 01:46:02.230309 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:02.230288 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/301d77ec-de77-49a0-a248-2d18119ab0d1-workload-socket\") pod \"301d77ec-de77-49a0-a248-2d18119ab0d1\" (UID: \"301d77ec-de77-49a0-a248-2d18119ab0d1\") " Jul 11 01:46:02.230512 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:02.230386 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/301d77ec-de77-49a0-a248-2d18119ab0d1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "301d77ec-de77-49a0-a248-2d18119ab0d1" (UID: "301d77ec-de77-49a0-a248-2d18119ab0d1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 01:46:02.230512 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:02.230413 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/301d77ec-de77-49a0-a248-2d18119ab0d1-istio-token\") pod \"301d77ec-de77-49a0-a248-2d18119ab0d1\" (UID: \"301d77ec-de77-49a0-a248-2d18119ab0d1\") " Jul 11 01:46:02.230512 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:02.230449 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/301d77ec-de77-49a0-a248-2d18119ab0d1-credential-socket\") pod \"301d77ec-de77-49a0-a248-2d18119ab0d1\" (UID: \"301d77ec-de77-49a0-a248-2d18119ab0d1\") " Jul 11 01:46:02.230512 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:02.230482 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/301d77ec-de77-49a0-a248-2d18119ab0d1-istiod-ca-cert\") pod \"301d77ec-de77-49a0-a248-2d18119ab0d1\" (UID: \"301d77ec-de77-49a0-a248-2d18119ab0d1\") " Jul 11 01:46:02.230739 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:02.230531 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g5s4d\" (UniqueName: \"kubernetes.io/projected/301d77ec-de77-49a0-a248-2d18119ab0d1-kube-api-access-g5s4d\") pod \"301d77ec-de77-49a0-a248-2d18119ab0d1\" (UID: \"301d77ec-de77-49a0-a248-2d18119ab0d1\") " Jul 11 01:46:02.230739 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:02.230679 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/301d77ec-de77-49a0-a248-2d18119ab0d1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "301d77ec-de77-49a0-a248-2d18119ab0d1" (UID: "301d77ec-de77-49a0-a248-2d18119ab0d1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 01:46:02.230919 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:02.230864 2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/301d77ec-de77-49a0-a248-2d18119ab0d1-workload-certs\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:46:02.230919 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:02.230892 2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/301d77ec-de77-49a0-a248-2d18119ab0d1-workload-socket\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:46:02.231238 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:02.231066 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/301d77ec-de77-49a0-a248-2d18119ab0d1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "301d77ec-de77-49a0-a248-2d18119ab0d1" (UID: "301d77ec-de77-49a0-a248-2d18119ab0d1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 01:46:02.231473 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:02.231441 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/301d77ec-de77-49a0-a248-2d18119ab0d1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "301d77ec-de77-49a0-a248-2d18119ab0d1" (UID: "301d77ec-de77-49a0-a248-2d18119ab0d1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 11 01:46:02.232424 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:02.232394 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/301d77ec-de77-49a0-a248-2d18119ab0d1-istio-data" (OuterVolumeSpecName: "istio-data") pod "301d77ec-de77-49a0-a248-2d18119ab0d1" (UID: "301d77ec-de77-49a0-a248-2d18119ab0d1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 01:46:02.232775 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:02.232749 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/301d77ec-de77-49a0-a248-2d18119ab0d1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "301d77ec-de77-49a0-a248-2d18119ab0d1" (UID: "301d77ec-de77-49a0-a248-2d18119ab0d1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 01:46:02.233079 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:02.233047 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/301d77ec-de77-49a0-a248-2d18119ab0d1-istio-token" (OuterVolumeSpecName: "istio-token") pod "301d77ec-de77-49a0-a248-2d18119ab0d1" (UID: "301d77ec-de77-49a0-a248-2d18119ab0d1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 11 01:46:02.233079 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:02.233065 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/301d77ec-de77-49a0-a248-2d18119ab0d1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "301d77ec-de77-49a0-a248-2d18119ab0d1" (UID: "301d77ec-de77-49a0-a248-2d18119ab0d1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 11 01:46:02.233210 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:02.233145 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/301d77ec-de77-49a0-a248-2d18119ab0d1-kube-api-access-g5s4d" (OuterVolumeSpecName: "kube-api-access-g5s4d") pod "301d77ec-de77-49a0-a248-2d18119ab0d1" (UID: "301d77ec-de77-49a0-a248-2d18119ab0d1"). InnerVolumeSpecName "kube-api-access-g5s4d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 11 01:46:02.331847 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:02.331802 2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/301d77ec-de77-49a0-a248-2d18119ab0d1-istio-podinfo\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:46:02.331847 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:02.331840 2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/301d77ec-de77-49a0-a248-2d18119ab0d1-istio-token\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:46:02.331847 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:02.331855 2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/301d77ec-de77-49a0-a248-2d18119ab0d1-credential-socket\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:46:02.332087 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:02.331866 2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/301d77ec-de77-49a0-a248-2d18119ab0d1-istiod-ca-cert\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:46:02.332087 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:02.331879 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g5s4d\" (UniqueName: \"kubernetes.io/projected/301d77ec-de77-49a0-a248-2d18119ab0d1-kube-api-access-g5s4d\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:46:02.332087 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:02.331890 2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/301d77ec-de77-49a0-a248-2d18119ab0d1-istio-envoy\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:46:02.332087 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:02.331900 2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/301d77ec-de77-49a0-a248-2d18119ab0d1-istio-data\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:46:02.554960 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:02.554866 2572 generic.go:356] "Generic (PLEG): container finished" podID="301d77ec-de77-49a0-a248-2d18119ab0d1" containerID="f0eb287f49e94a42ca34970bd7eb50304a512cbd687e36b9e89b70554ee970c3" exitCode=0 Jul 11 01:46:02.554960 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:02.554913 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp" Jul 11 01:46:02.554960 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:02.554948 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp" event={"ID":"301d77ec-de77-49a0-a248-2d18119ab0d1","Type":"ContainerDied","Data":"f0eb287f49e94a42ca34970bd7eb50304a512cbd687e36b9e89b70554ee970c3"} Jul 11 01:46:02.555205 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:02.555005 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp" event={"ID":"301d77ec-de77-49a0-a248-2d18119ab0d1","Type":"ContainerDied","Data":"028c1664620a49ee88ae9752ee2aa1012b26b58ee9e240f229d275b838fa17de"} Jul 11 01:46:02.555205 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:02.555029 2572 scope.go:117] "RemoveContainer" containerID="f0eb287f49e94a42ca34970bd7eb50304a512cbd687e36b9e89b70554ee970c3" Jul 11 01:46:02.565351 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:02.565330 2572 scope.go:117] "RemoveContainer" containerID="768a452b46fd69b99f2f076b04d802a1763f40682ffee585c7e85c0e4a5b0941" Jul 11 01:46:02.573000 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:02.572981 2572 scope.go:117] "RemoveContainer" containerID="f0eb287f49e94a42ca34970bd7eb50304a512cbd687e36b9e89b70554ee970c3" Jul 11 01:46:02.573286 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:46:02.573269 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0eb287f49e94a42ca34970bd7eb50304a512cbd687e36b9e89b70554ee970c3\": container with ID starting with f0eb287f49e94a42ca34970bd7eb50304a512cbd687e36b9e89b70554ee970c3 not found: ID does not exist" containerID="f0eb287f49e94a42ca34970bd7eb50304a512cbd687e36b9e89b70554ee970c3" Jul 11 01:46:02.573327 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:02.573296 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0eb287f49e94a42ca34970bd7eb50304a512cbd687e36b9e89b70554ee970c3"} err="failed to get container status \"f0eb287f49e94a42ca34970bd7eb50304a512cbd687e36b9e89b70554ee970c3\": rpc error: code = NotFound desc = could not find container \"f0eb287f49e94a42ca34970bd7eb50304a512cbd687e36b9e89b70554ee970c3\": container with ID starting with f0eb287f49e94a42ca34970bd7eb50304a512cbd687e36b9e89b70554ee970c3 not found: ID does not exist" Jul 11 01:46:02.573327 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:02.573316 2572 scope.go:117] "RemoveContainer" containerID="768a452b46fd69b99f2f076b04d802a1763f40682ffee585c7e85c0e4a5b0941" Jul 11 01:46:02.573553 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:46:02.573535 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"768a452b46fd69b99f2f076b04d802a1763f40682ffee585c7e85c0e4a5b0941\": container with ID starting with 768a452b46fd69b99f2f076b04d802a1763f40682ffee585c7e85c0e4a5b0941 not found: ID does not exist" containerID="768a452b46fd69b99f2f076b04d802a1763f40682ffee585c7e85c0e4a5b0941" Jul 11 01:46:02.573589 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:02.573560 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"768a452b46fd69b99f2f076b04d802a1763f40682ffee585c7e85c0e4a5b0941"} err="failed to get container status \"768a452b46fd69b99f2f076b04d802a1763f40682ffee585c7e85c0e4a5b0941\": rpc error: code = NotFound desc = could not find container \"768a452b46fd69b99f2f076b04d802a1763f40682ffee585c7e85c0e4a5b0941\": container with ID starting with 768a452b46fd69b99f2f076b04d802a1763f40682ffee585c7e85c0e4a5b0941 not found: ID does not exist" Jul 11 01:46:02.603462 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:02.603428 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp"] Jul 11 01:46:02.612666 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:02.612639 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-83b6ef8d-openshift-default-57645f59f5-w2wsp"] Jul 11 01:46:04.261811 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:04.261781 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="301d77ec-de77-49a0-a248-2d18119ab0d1" path="/var/lib/kubelet/pods/301d77ec-de77-49a0-a248-2d18119ab0d1/volumes" Jul 11 01:46:53.589769 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:53.589735 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk"] Jul 11 01:46:53.590202 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:53.590015 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="301d77ec-de77-49a0-a248-2d18119ab0d1" containerName="istio-proxy" Jul 11 01:46:53.590202 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:53.590025 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="301d77ec-de77-49a0-a248-2d18119ab0d1" containerName="istio-proxy" Jul 11 01:46:53.590202 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:53.590046 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92657f17-c9fe-44c7-a3f7-63e301e100ed" containerName="istio-proxy" Jul 11 01:46:53.590202 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:53.590052 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="92657f17-c9fe-44c7-a3f7-63e301e100ed" containerName="istio-proxy" Jul 11 01:46:53.590202 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:53.590098 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="301d77ec-de77-49a0-a248-2d18119ab0d1" containerName="istio-proxy" Jul 11 01:46:53.590202 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:53.590107 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="92657f17-c9fe-44c7-a3f7-63e301e100ed" containerName="istio-proxy" Jul 11 01:46:53.593120 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:53.593102 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk" Jul 11 01:46:53.595561 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:53.595541 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-62c633-openshift-default-dockercfg-cbcdc\"" Jul 11 01:46:53.604686 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:53.604660 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk"] Jul 11 01:46:53.773719 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:53.773659 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c-istio-podinfo\") pod \"e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk\" (UID: \"bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c\") " pod="openshift-ingress/e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk" Jul 11 01:46:53.773917 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:53.773792 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c-workload-socket\") pod \"e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk\" (UID: \"bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c\") " pod="openshift-ingress/e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk" Jul 11 01:46:53.773917 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:53.773854 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c-istio-envoy\") pod \"e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk\" (UID: \"bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c\") " pod="openshift-ingress/e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk" Jul 11 01:46:53.773917 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:53.773883 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c-istio-token\") pod \"e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk\" (UID: \"bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c\") " pod="openshift-ingress/e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk" Jul 11 01:46:53.774100 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:53.773966 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c-workload-certs\") pod \"e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk\" (UID: \"bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c\") " pod="openshift-ingress/e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk" Jul 11 01:46:53.774100 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:53.773995 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c-credential-socket\") pod \"e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk\" (UID: \"bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c\") " pod="openshift-ingress/e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk" Jul 11 01:46:53.774100 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:53.774036 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c-istio-data\") pod \"e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk\" (UID: \"bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c\") " pod="openshift-ingress/e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk" Jul 11 01:46:53.774246 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:53.774116 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c-istiod-ca-cert\") pod \"e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk\" (UID: \"bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c\") " pod="openshift-ingress/e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk" Jul 11 01:46:53.774246 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:53.774157 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msb2n\" (UniqueName: \"kubernetes.io/projected/bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c-kube-api-access-msb2n\") pod \"e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk\" (UID: \"bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c\") " pod="openshift-ingress/e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk" Jul 11 01:46:53.874737 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:53.874601 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c-istio-podinfo\") pod \"e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk\" (UID: \"bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c\") " pod="openshift-ingress/e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk" Jul 11 01:46:53.874737 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:53.874650 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c-workload-socket\") pod \"e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk\" (UID: \"bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c\") " pod="openshift-ingress/e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk" Jul 11 01:46:53.874737 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:53.874672 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c-istio-envoy\") pod \"e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk\" (UID: \"bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c\") " pod="openshift-ingress/e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk" Jul 11 01:46:53.874737 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:53.874689 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c-istio-token\") pod \"e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk\" (UID: \"bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c\") " pod="openshift-ingress/e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk" Jul 11 01:46:53.875066 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:53.874758 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c-workload-certs\") pod \"e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk\" (UID: \"bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c\") " pod="openshift-ingress/e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk" Jul 11 01:46:53.875066 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:53.874784 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c-credential-socket\") pod \"e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk\" (UID: \"bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c\") " pod="openshift-ingress/e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk" Jul 11 01:46:53.875066 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:53.874824 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c-istio-data\") pod \"e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk\" (UID: \"bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c\") " pod="openshift-ingress/e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk" Jul 11 01:46:53.875066 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:53.874854 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c-istiod-ca-cert\") pod \"e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk\" (UID: \"bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c\") " pod="openshift-ingress/e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk" Jul 11 01:46:53.875066 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:53.874880 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msb2n\" (UniqueName: \"kubernetes.io/projected/bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c-kube-api-access-msb2n\") pod \"e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk\" (UID: \"bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c\") " pod="openshift-ingress/e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk" Jul 11 01:46:53.875278 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:53.875082 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c-workload-socket\") pod \"e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk\" (UID: \"bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c\") " pod="openshift-ingress/e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk" Jul 11 01:46:53.875278 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:53.875213 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c-workload-certs\") pod \"e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk\" (UID: \"bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c\") " pod="openshift-ingress/e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk" Jul 11 01:46:53.875354 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:53.875306 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c-istio-data\") pod \"e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk\" (UID: \"bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c\") " pod="openshift-ingress/e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk" Jul 11 01:46:53.875448 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:53.875430 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c-credential-socket\") pod \"e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk\" (UID: \"bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c\") " pod="openshift-ingress/e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk" Jul 11 01:46:53.875788 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:53.875766 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c-istiod-ca-cert\") pod \"e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk\" (UID: \"bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c\") " pod="openshift-ingress/e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk" Jul 11 01:46:53.877155 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:53.877134 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c-istio-envoy\") pod \"e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk\" (UID: \"bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c\") " pod="openshift-ingress/e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk" Jul 11 01:46:53.877239 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:53.877192 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c-istio-podinfo\") pod \"e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk\" (UID: \"bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c\") " pod="openshift-ingress/e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk" Jul 11 01:46:53.882301 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:53.882278 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c-istio-token\") pod \"e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk\" (UID: \"bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c\") " pod="openshift-ingress/e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk" Jul 11 01:46:53.882471 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:53.882453 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-msb2n\" (UniqueName: \"kubernetes.io/projected/bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c-kube-api-access-msb2n\") pod \"e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk\" (UID: \"bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c\") " pod="openshift-ingress/e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk" Jul 11 01:46:53.902432 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:53.902400 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk" Jul 11 01:46:54.037005 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:54.036978 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk"] Jul 11 01:46:54.039409 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:46:54.039376 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfbd3cad_fbf9_4883_8bb0_0dbba3e1728c.slice/crio-80f6f38b146c2893b5457414288fa86fe6cf2142f012e987ac3120c44fd5eb77 WatchSource:0}: Error finding container 80f6f38b146c2893b5457414288fa86fe6cf2142f012e987ac3120c44fd5eb77: Status 404 returned error can't find the container with id 80f6f38b146c2893b5457414288fa86fe6cf2142f012e987ac3120c44fd5eb77 Jul 11 01:46:54.046614 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:54.046558 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:46:54.046836 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:54.046759 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:46:54.047119 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:54.047092 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:46:54.772053 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:54.772015 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk" event={"ID":"bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c","Type":"ContainerStarted","Data":"d7bc0b2f3ab52c1800eab62136ff13ed0149a9c282aadb190c962037046cb337"} Jul 11 01:46:54.772431 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:54.772067 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk" event={"ID":"bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c","Type":"ContainerStarted","Data":"80f6f38b146c2893b5457414288fa86fe6cf2142f012e987ac3120c44fd5eb77"} Jul 11 01:46:54.793690 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:54.793638 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk" podStartSLOduration=1.793622419 podStartE2EDuration="1.793622419s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:46:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:46:54.791364204 +0000 UTC m=+2419.122839784" watchObservedRunningTime="2026-07-11 01:46:54.793622419 +0000 UTC m=+2419.125097963" Jul 11 01:46:54.903465 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:54.903430 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk" Jul 11 01:46:55.907599 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:55.907572 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk" Jul 11 01:46:56.780624 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:56.780598 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk" Jul 11 01:46:56.781689 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:46:56.781673 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk" Jul 11 01:47:01.762064 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:01.762033 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw"] Jul 11 01:47:01.762427 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:01.762327 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="301d77ec-de77-49a0-a248-2d18119ab0d1" containerName="istio-proxy" Jul 11 01:47:01.762427 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:01.762338 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="301d77ec-de77-49a0-a248-2d18119ab0d1" containerName="istio-proxy" Jul 11 01:47:01.762427 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:01.762379 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="301d77ec-de77-49a0-a248-2d18119ab0d1" containerName="istio-proxy" Jul 11 01:47:01.765417 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:01.765399 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw" Jul 11 01:47:01.768049 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:01.768025 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-1e79cd-openshift-default-dockercfg-nx46w\"" Jul 11 01:47:01.778042 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:01.778014 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw"] Jul 11 01:47:01.949222 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:01.949181 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/644ad741-5f3c-409f-ab3c-51f0a892602c-istiod-ca-cert\") pod \"e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw\" (UID: \"644ad741-5f3c-409f-ab3c-51f0a892602c\") " pod="openshift-ingress/e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw" Jul 11 01:47:01.949222 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:01.949225 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/644ad741-5f3c-409f-ab3c-51f0a892602c-istio-token\") pod \"e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw\" (UID: \"644ad741-5f3c-409f-ab3c-51f0a892602c\") " pod="openshift-ingress/e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw" Jul 11 01:47:01.949462 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:01.949268 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/644ad741-5f3c-409f-ab3c-51f0a892602c-istio-envoy\") pod \"e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw\" (UID: \"644ad741-5f3c-409f-ab3c-51f0a892602c\") " pod="openshift-ingress/e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw" Jul 11 01:47:01.949462 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:01.949284 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/644ad741-5f3c-409f-ab3c-51f0a892602c-workload-socket\") pod \"e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw\" (UID: \"644ad741-5f3c-409f-ab3c-51f0a892602c\") " pod="openshift-ingress/e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw" Jul 11 01:47:01.949462 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:01.949310 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/644ad741-5f3c-409f-ab3c-51f0a892602c-istio-data\") pod \"e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw\" (UID: \"644ad741-5f3c-409f-ab3c-51f0a892602c\") " pod="openshift-ingress/e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw" Jul 11 01:47:01.949462 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:01.949355 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/644ad741-5f3c-409f-ab3c-51f0a892602c-istio-podinfo\") pod \"e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw\" (UID: \"644ad741-5f3c-409f-ab3c-51f0a892602c\") " pod="openshift-ingress/e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw" Jul 11 01:47:01.949462 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:01.949396 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/644ad741-5f3c-409f-ab3c-51f0a892602c-credential-socket\") pod \"e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw\" (UID: \"644ad741-5f3c-409f-ab3c-51f0a892602c\") " pod="openshift-ingress/e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw" Jul 11 01:47:01.949462 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:01.949424 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hcrw\" (UniqueName: \"kubernetes.io/projected/644ad741-5f3c-409f-ab3c-51f0a892602c-kube-api-access-2hcrw\") pod \"e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw\" (UID: \"644ad741-5f3c-409f-ab3c-51f0a892602c\") " pod="openshift-ingress/e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw" Jul 11 01:47:01.949665 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:01.949471 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/644ad741-5f3c-409f-ab3c-51f0a892602c-workload-certs\") pod \"e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw\" (UID: \"644ad741-5f3c-409f-ab3c-51f0a892602c\") " pod="openshift-ingress/e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw" Jul 11 01:47:02.050902 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:02.050810 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/644ad741-5f3c-409f-ab3c-51f0a892602c-istio-podinfo\") pod \"e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw\" (UID: \"644ad741-5f3c-409f-ab3c-51f0a892602c\") " pod="openshift-ingress/e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw" Jul 11 01:47:02.050902 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:02.050859 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/644ad741-5f3c-409f-ab3c-51f0a892602c-credential-socket\") pod \"e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw\" (UID: \"644ad741-5f3c-409f-ab3c-51f0a892602c\") " pod="openshift-ingress/e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw" Jul 11 01:47:02.050902 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:02.050880 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hcrw\" (UniqueName: \"kubernetes.io/projected/644ad741-5f3c-409f-ab3c-51f0a892602c-kube-api-access-2hcrw\") pod \"e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw\" (UID: \"644ad741-5f3c-409f-ab3c-51f0a892602c\") " pod="openshift-ingress/e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw" Jul 11 01:47:02.051149 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:02.051002 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/644ad741-5f3c-409f-ab3c-51f0a892602c-workload-certs\") pod \"e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw\" (UID: \"644ad741-5f3c-409f-ab3c-51f0a892602c\") " pod="openshift-ingress/e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw" Jul 11 01:47:02.051149 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:02.051080 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/644ad741-5f3c-409f-ab3c-51f0a892602c-istiod-ca-cert\") pod \"e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw\" (UID: \"644ad741-5f3c-409f-ab3c-51f0a892602c\") " pod="openshift-ingress/e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw" Jul 11 01:47:02.051149 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:02.051114 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/644ad741-5f3c-409f-ab3c-51f0a892602c-istio-token\") pod \"e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw\" (UID: \"644ad741-5f3c-409f-ab3c-51f0a892602c\") " pod="openshift-ingress/e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw" Jul 11 01:47:02.051291 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:02.051189 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/644ad741-5f3c-409f-ab3c-51f0a892602c-istio-envoy\") pod \"e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw\" (UID: \"644ad741-5f3c-409f-ab3c-51f0a892602c\") " pod="openshift-ingress/e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw" Jul 11 01:47:02.051291 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:02.051215 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/644ad741-5f3c-409f-ab3c-51f0a892602c-workload-socket\") pod \"e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw\" (UID: \"644ad741-5f3c-409f-ab3c-51f0a892602c\") " pod="openshift-ingress/e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw" Jul 11 01:47:02.051291 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:02.051261 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/644ad741-5f3c-409f-ab3c-51f0a892602c-istio-data\") pod \"e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw\" (UID: \"644ad741-5f3c-409f-ab3c-51f0a892602c\") " pod="openshift-ingress/e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw" Jul 11 01:47:02.051651 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:02.051261 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/644ad741-5f3c-409f-ab3c-51f0a892602c-credential-socket\") pod \"e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw\" (UID: \"644ad741-5f3c-409f-ab3c-51f0a892602c\") " pod="openshift-ingress/e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw" Jul 11 01:47:02.051651 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:02.051359 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/644ad741-5f3c-409f-ab3c-51f0a892602c-workload-certs\") pod \"e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw\" (UID: \"644ad741-5f3c-409f-ab3c-51f0a892602c\") " pod="openshift-ingress/e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw" Jul 11 01:47:02.051651 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:02.051624 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/644ad741-5f3c-409f-ab3c-51f0a892602c-istio-data\") pod \"e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw\" (UID: \"644ad741-5f3c-409f-ab3c-51f0a892602c\") " pod="openshift-ingress/e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw" Jul 11 01:47:02.051651 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:02.051619 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/644ad741-5f3c-409f-ab3c-51f0a892602c-workload-socket\") pod \"e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw\" (UID: \"644ad741-5f3c-409f-ab3c-51f0a892602c\") " pod="openshift-ingress/e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw" Jul 11 01:47:02.051912 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:02.051860 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/644ad741-5f3c-409f-ab3c-51f0a892602c-istiod-ca-cert\") pod \"e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw\" (UID: \"644ad741-5f3c-409f-ab3c-51f0a892602c\") " pod="openshift-ingress/e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw" Jul 11 01:47:02.053751 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:02.053728 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/644ad741-5f3c-409f-ab3c-51f0a892602c-istio-envoy\") pod \"e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw\" (UID: \"644ad741-5f3c-409f-ab3c-51f0a892602c\") " pod="openshift-ingress/e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw" Jul 11 01:47:02.054079 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:02.054059 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/644ad741-5f3c-409f-ab3c-51f0a892602c-istio-podinfo\") pod \"e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw\" (UID: \"644ad741-5f3c-409f-ab3c-51f0a892602c\") " pod="openshift-ingress/e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw" Jul 11 01:47:02.059245 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:02.059217 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/644ad741-5f3c-409f-ab3c-51f0a892602c-istio-token\") pod \"e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw\" (UID: \"644ad741-5f3c-409f-ab3c-51f0a892602c\") " pod="openshift-ingress/e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw" Jul 11 01:47:02.059387 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:02.059371 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hcrw\" (UniqueName: \"kubernetes.io/projected/644ad741-5f3c-409f-ab3c-51f0a892602c-kube-api-access-2hcrw\") pod \"e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw\" (UID: \"644ad741-5f3c-409f-ab3c-51f0a892602c\") " pod="openshift-ingress/e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw" Jul 11 01:47:02.076215 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:02.076188 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw" Jul 11 01:47:02.207999 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:02.207954 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw"] Jul 11 01:47:02.210205 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:47:02.210174 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod644ad741_5f3c_409f_ab3c_51f0a892602c.slice/crio-0781e96f71d3adc1a16a5b10c0def6ba97c49737c8d16ac8496c207fc78412a6 WatchSource:0}: Error finding container 0781e96f71d3adc1a16a5b10c0def6ba97c49737c8d16ac8496c207fc78412a6: Status 404 returned error can't find the container with id 0781e96f71d3adc1a16a5b10c0def6ba97c49737c8d16ac8496c207fc78412a6 Jul 11 01:47:02.212437 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:02.212400 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:47:02.212510 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:02.212485 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:47:02.212547 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:02.212523 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:47:02.807412 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:02.807371 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw" event={"ID":"644ad741-5f3c-409f-ab3c-51f0a892602c","Type":"ContainerStarted","Data":"d37f9afdf24d763212ef5636e076aba363374e1d25e27b59e013fc05c0ed49aa"} Jul 11 01:47:02.807955 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:02.807445 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw" event={"ID":"644ad741-5f3c-409f-ab3c-51f0a892602c","Type":"ContainerStarted","Data":"0781e96f71d3adc1a16a5b10c0def6ba97c49737c8d16ac8496c207fc78412a6"} Jul 11 01:47:02.827941 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:02.827879 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw" podStartSLOduration=1.827862571 podStartE2EDuration="1.827862571s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:47:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:47:02.826205064 +0000 UTC m=+2427.157680619" watchObservedRunningTime="2026-07-11 01:47:02.827862571 +0000 UTC m=+2427.159338115" Jul 11 01:47:03.077044 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:03.076947 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw" Jul 11 01:47:03.081965 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:03.081936 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw" Jul 11 01:47:03.812016 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:03.811982 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw" Jul 11 01:47:03.813071 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:03.813051 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw" Jul 11 01:47:12.822912 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:12.822861 2572 patch_prober.go:28] interesting pod/e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 11 01:47:12.823382 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:12.822949 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk" podUID="bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 11 01:47:13.860290 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:13.860259 2572 generic.go:356] "Generic (PLEG): container finished" podID="bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c" containerID="d7bc0b2f3ab52c1800eab62136ff13ed0149a9c282aadb190c962037046cb337" exitCode=0 Jul 11 01:47:13.860725 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:13.860337 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk" event={"ID":"bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c","Type":"ContainerDied","Data":"d7bc0b2f3ab52c1800eab62136ff13ed0149a9c282aadb190c962037046cb337"} Jul 11 01:47:13.860850 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:13.860835 2572 scope.go:117] "RemoveContainer" containerID="d7bc0b2f3ab52c1800eab62136ff13ed0149a9c282aadb190c962037046cb337" Jul 11 01:47:13.861889 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:13.861861 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:47:13.861950 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:13.861934 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:47:13.861983 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:13.861966 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:47:14.870092 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:14.869158 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk" event={"ID":"bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c","Type":"ContainerStarted","Data":"fca0c035f7459eaf4e2aabfa4ddcda5f0698175b9bc86c804051d5fc7a7a0472"} Jul 11 01:47:14.903204 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:14.903177 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk" Jul 11 01:47:14.903419 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:14.903351 2572 patch_prober.go:28] interesting pod/e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Jul 11 01:47:14.903521 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:14.903501 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk" podUID="bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Jul 11 01:47:15.903514 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:15.903476 2572 patch_prober.go:28] interesting pod/e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Jul 11 01:47:15.904015 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:15.903989 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk" podUID="bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Jul 11 01:47:16.902970 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:16.902940 2572 patch_prober.go:28] interesting pod/e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Jul 11 01:47:16.903214 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:16.903192 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk" podUID="bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Jul 11 01:47:17.903552 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:17.903517 2572 patch_prober.go:28] interesting pod/e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Jul 11 01:47:17.903969 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:17.903583 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk" podUID="bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Jul 11 01:47:18.906813 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:18.906784 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk" Jul 11 01:47:18.907271 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:18.907066 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk" Jul 11 01:47:18.907969 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:18.907941 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk" Jul 11 01:47:19.854870 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:19.854829 2572 patch_prober.go:28] interesting pod/e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 11 01:47:19.855047 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:19.854913 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw" podUID="644ad741-5f3c-409f-ab3c-51f0a892602c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 11 01:47:20.900046 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:20.899938 2572 generic.go:356] "Generic (PLEG): container finished" podID="644ad741-5f3c-409f-ab3c-51f0a892602c" containerID="d37f9afdf24d763212ef5636e076aba363374e1d25e27b59e013fc05c0ed49aa" exitCode=0 Jul 11 01:47:20.900046 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:20.900014 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw" event={"ID":"644ad741-5f3c-409f-ab3c-51f0a892602c","Type":"ContainerDied","Data":"d37f9afdf24d763212ef5636e076aba363374e1d25e27b59e013fc05c0ed49aa"} Jul 11 01:47:20.900604 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:20.900484 2572 scope.go:117] "RemoveContainer" containerID="d37f9afdf24d763212ef5636e076aba363374e1d25e27b59e013fc05c0ed49aa" Jul 11 01:47:20.901548 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:20.901523 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:47:20.901623 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:20.901609 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:47:20.901664 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:20.901647 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:47:21.905713 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:21.905663 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw" event={"ID":"644ad741-5f3c-409f-ab3c-51f0a892602c","Type":"ContainerStarted","Data":"66c9ed07e39c2ac4509e757033531aa3d86b952756b1fd24b9dbcb0a9e48698a"} Jul 11 01:47:22.076787 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:22.076747 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw" Jul 11 01:47:22.077092 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:22.077064 2572 patch_prober.go:28] interesting pod/e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body= Jul 11 01:47:22.077158 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:22.077133 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw" podUID="644ad741-5f3c-409f-ab3c-51f0a892602c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" Jul 11 01:47:23.077504 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:23.077463 2572 patch_prober.go:28] interesting pod/e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body= Jul 11 01:47:23.078000 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:23.077533 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw" podUID="644ad741-5f3c-409f-ab3c-51f0a892602c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" Jul 11 01:47:24.077080 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:24.077043 2572 patch_prober.go:28] interesting pod/e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body= Jul 11 01:47:24.077262 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:24.077104 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw" podUID="644ad741-5f3c-409f-ab3c-51f0a892602c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" Jul 11 01:47:25.076727 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:25.076670 2572 patch_prober.go:28] interesting pod/e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body= Jul 11 01:47:25.077217 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:25.076747 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw" podUID="644ad741-5f3c-409f-ab3c-51f0a892602c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" Jul 11 01:47:26.080499 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:26.080468 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw" Jul 11 01:47:26.080918 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:26.080814 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw" Jul 11 01:47:26.081483 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:47:26.081469 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw" Jul 11 01:48:44.550067 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:48:44.549972 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk"] Jul 11 01:48:44.550538 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:48:44.550250 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk" podUID="bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c" containerName="istio-proxy" containerID="cri-o://fca0c035f7459eaf4e2aabfa4ddcda5f0698175b9bc86c804051d5fc7a7a0472" gracePeriod=30 Jul 11 01:48:48.910107 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:48:48.910058 2572 patch_prober.go:28] interesting pod/e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 11 01:48:48.910486 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:48:48.910131 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk" podUID="bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 11 01:48:49.808534 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:48:49.808508 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk" Jul 11 01:48:49.919067 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:48:49.918960 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c-istio-data\") pod \"bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c\" (UID: \"bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c\") " Jul 11 01:48:49.919067 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:48:49.919011 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c-istio-podinfo\") pod \"bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c\" (UID: \"bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c\") " Jul 11 01:48:49.919589 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:48:49.919084 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c-workload-socket\") pod \"bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c\" (UID: \"bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c\") " Jul 11 01:48:49.919589 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:48:49.919110 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c-istio-token\") pod \"bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c\" (UID: \"bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c\") " Jul 11 01:48:49.919589 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:48:49.919135 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c-workload-certs\") pod \"bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c\" (UID: \"bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c\") " Jul 11 01:48:49.919589 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:48:49.919166 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-msb2n\" (UniqueName: \"kubernetes.io/projected/bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c-kube-api-access-msb2n\") pod \"bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c\" (UID: \"bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c\") " Jul 11 01:48:49.919589 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:48:49.919203 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c-istio-envoy\") pod \"bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c\" (UID: \"bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c\") " Jul 11 01:48:49.919589 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:48:49.919241 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c-istiod-ca-cert\") pod \"bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c\" (UID: \"bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c\") " Jul 11 01:48:49.919589 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:48:49.919285 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c-credential-socket\") pod \"bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c\" (UID: \"bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c\") " Jul 11 01:48:49.919589 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:48:49.919439 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c" (UID: "bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 01:48:49.919589 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:48:49.919529 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c" (UID: "bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 01:48:49.920051 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:48:49.919644 2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c-workload-certs\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:48:49.920051 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:48:49.919665 2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c-workload-socket\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:48:49.920051 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:48:49.919731 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c" (UID: "bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 01:48:49.920051 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:48:49.919827 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c" (UID: "bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 11 01:48:49.920212 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:48:49.920078 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c-istio-data" (OuterVolumeSpecName: "istio-data") pod "bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c" (UID: "bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 01:48:49.921531 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:48:49.921504 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c-kube-api-access-msb2n" (OuterVolumeSpecName: "kube-api-access-msb2n") pod "bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c" (UID: "bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c"). InnerVolumeSpecName "kube-api-access-msb2n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 11 01:48:49.921654 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:48:49.921534 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c" (UID: "bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 01:48:49.921820 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:48:49.921793 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c" (UID: "bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 11 01:48:49.921820 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:48:49.921805 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c-istio-token" (OuterVolumeSpecName: "istio-token") pod "bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c" (UID: "bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 11 01:48:50.020214 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:48:50.020175 2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c-credential-socket\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:48:50.020214 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:48:50.020208 2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c-istio-data\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:48:50.020214 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:48:50.020219 2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c-istio-podinfo\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:48:50.020214 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:48:50.020227 2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c-istio-token\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:48:50.020478 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:48:50.020236 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-msb2n\" (UniqueName: \"kubernetes.io/projected/bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c-kube-api-access-msb2n\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:48:50.020478 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:48:50.020247 2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c-istio-envoy\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:48:50.020478 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:48:50.020256 2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c-istiod-ca-cert\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:48:50.269032 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:48:50.268988 2572 generic.go:356] "Generic (PLEG): container finished" podID="bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c" containerID="fca0c035f7459eaf4e2aabfa4ddcda5f0698175b9bc86c804051d5fc7a7a0472" exitCode=0 Jul 11 01:48:50.269188 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:48:50.269050 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk" Jul 11 01:48:50.269188 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:48:50.269071 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk" event={"ID":"bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c","Type":"ContainerDied","Data":"fca0c035f7459eaf4e2aabfa4ddcda5f0698175b9bc86c804051d5fc7a7a0472"} Jul 11 01:48:50.269188 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:48:50.269135 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk" event={"ID":"bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c","Type":"ContainerDied","Data":"80f6f38b146c2893b5457414288fa86fe6cf2142f012e987ac3120c44fd5eb77"} Jul 11 01:48:50.269188 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:48:50.269160 2572 scope.go:117] "RemoveContainer" containerID="fca0c035f7459eaf4e2aabfa4ddcda5f0698175b9bc86c804051d5fc7a7a0472" Jul 11 01:48:50.277943 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:48:50.277924 2572 scope.go:117] "RemoveContainer" containerID="d7bc0b2f3ab52c1800eab62136ff13ed0149a9c282aadb190c962037046cb337" Jul 11 01:48:50.285302 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:48:50.285283 2572 scope.go:117] "RemoveContainer" containerID="fca0c035f7459eaf4e2aabfa4ddcda5f0698175b9bc86c804051d5fc7a7a0472" Jul 11 01:48:50.286044 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:48:50.285676 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fca0c035f7459eaf4e2aabfa4ddcda5f0698175b9bc86c804051d5fc7a7a0472\": container with ID starting with fca0c035f7459eaf4e2aabfa4ddcda5f0698175b9bc86c804051d5fc7a7a0472 not found: ID does not exist" containerID="fca0c035f7459eaf4e2aabfa4ddcda5f0698175b9bc86c804051d5fc7a7a0472" Jul 11 01:48:50.286044 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:48:50.285733 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fca0c035f7459eaf4e2aabfa4ddcda5f0698175b9bc86c804051d5fc7a7a0472"} err="failed to get container status \"fca0c035f7459eaf4e2aabfa4ddcda5f0698175b9bc86c804051d5fc7a7a0472\": rpc error: code = NotFound desc = could not find container \"fca0c035f7459eaf4e2aabfa4ddcda5f0698175b9bc86c804051d5fc7a7a0472\": container with ID starting with fca0c035f7459eaf4e2aabfa4ddcda5f0698175b9bc86c804051d5fc7a7a0472 not found: ID does not exist" Jul 11 01:48:50.286044 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:48:50.285758 2572 scope.go:117] "RemoveContainer" containerID="d7bc0b2f3ab52c1800eab62136ff13ed0149a9c282aadb190c962037046cb337" Jul 11 01:48:50.286509 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:48:50.286486 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7bc0b2f3ab52c1800eab62136ff13ed0149a9c282aadb190c962037046cb337\": container with ID starting with d7bc0b2f3ab52c1800eab62136ff13ed0149a9c282aadb190c962037046cb337 not found: ID does not exist" containerID="d7bc0b2f3ab52c1800eab62136ff13ed0149a9c282aadb190c962037046cb337" Jul 11 01:48:50.286611 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:48:50.286516 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7bc0b2f3ab52c1800eab62136ff13ed0149a9c282aadb190c962037046cb337"} err="failed to get container status \"d7bc0b2f3ab52c1800eab62136ff13ed0149a9c282aadb190c962037046cb337\": rpc error: code = NotFound desc = could not find container \"d7bc0b2f3ab52c1800eab62136ff13ed0149a9c282aadb190c962037046cb337\": container with ID starting with d7bc0b2f3ab52c1800eab62136ff13ed0149a9c282aadb190c962037046cb337 not found: ID does not exist" Jul 11 01:48:50.287808 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:48:50.287786 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk"] Jul 11 01:48:50.294206 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:48:50.294183 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-62c633-openshift-default-847876b7d7-26ppk"] Jul 11 01:48:52.255937 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:48:52.255900 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c" path="/var/lib/kubelet/pods/bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c/volumes" Jul 11 01:49:10.622650 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:10.622611 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw"] Jul 11 01:49:10.623243 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:10.622892 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw" podUID="644ad741-5f3c-409f-ab3c-51f0a892602c" containerName="istio-proxy" containerID="cri-o://66c9ed07e39c2ac4509e757033531aa3d86b952756b1fd24b9dbcb0a9e48698a" gracePeriod=30 Jul 11 01:49:11.083481 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:11.083434 2572 patch_prober.go:28] interesting pod/e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 11 01:49:11.083648 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:11.083502 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw" podUID="644ad741-5f3c-409f-ab3c-51f0a892602c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 11 01:49:11.512113 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:11.512077 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b"] Jul 11 01:49:11.512369 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:11.512358 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c" containerName="istio-proxy" Jul 11 01:49:11.512413 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:11.512371 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c" containerName="istio-proxy" Jul 11 01:49:11.512452 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:11.512430 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c" containerName="istio-proxy" Jul 11 01:49:11.516860 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:11.516840 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b" Jul 11 01:49:11.519850 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:11.519825 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-1e2f0c-openshift-default-dockercfg-xbf62\"" Jul 11 01:49:11.525629 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:11.525606 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b"] Jul 11 01:49:11.616838 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:11.616803 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b366829-3755-421d-b5d8-4b6a378262cd-istio-data\") pod \"e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b\" (UID: \"3b366829-3755-421d-b5d8-4b6a378262cd\") " pod="openshift-ingress/e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b" Jul 11 01:49:11.617025 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:11.616847 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b366829-3755-421d-b5d8-4b6a378262cd-credential-socket\") pod \"e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b\" (UID: \"3b366829-3755-421d-b5d8-4b6a378262cd\") " pod="openshift-ingress/e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b" Jul 11 01:49:11.617025 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:11.616915 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b366829-3755-421d-b5d8-4b6a378262cd-istio-token\") pod \"e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b\" (UID: \"3b366829-3755-421d-b5d8-4b6a378262cd\") " pod="openshift-ingress/e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b" Jul 11 01:49:11.617025 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:11.616946 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b366829-3755-421d-b5d8-4b6a378262cd-workload-socket\") pod \"e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b\" (UID: \"3b366829-3755-421d-b5d8-4b6a378262cd\") " pod="openshift-ingress/e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b" Jul 11 01:49:11.617025 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:11.616967 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b366829-3755-421d-b5d8-4b6a378262cd-workload-certs\") pod \"e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b\" (UID: \"3b366829-3755-421d-b5d8-4b6a378262cd\") " pod="openshift-ingress/e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b" Jul 11 01:49:11.617025 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:11.616985 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b366829-3755-421d-b5d8-4b6a378262cd-istio-podinfo\") pod \"e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b\" (UID: \"3b366829-3755-421d-b5d8-4b6a378262cd\") " pod="openshift-ingress/e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b" Jul 11 01:49:11.617025 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:11.617002 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b366829-3755-421d-b5d8-4b6a378262cd-istiod-ca-cert\") pod \"e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b\" (UID: \"3b366829-3755-421d-b5d8-4b6a378262cd\") " pod="openshift-ingress/e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b" Jul 11 01:49:11.617277 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:11.617028 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b366829-3755-421d-b5d8-4b6a378262cd-istio-envoy\") pod \"e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b\" (UID: \"3b366829-3755-421d-b5d8-4b6a378262cd\") " pod="openshift-ingress/e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b" Jul 11 01:49:11.617277 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:11.617111 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79zz6\" (UniqueName: \"kubernetes.io/projected/3b366829-3755-421d-b5d8-4b6a378262cd-kube-api-access-79zz6\") pod \"e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b\" (UID: \"3b366829-3755-421d-b5d8-4b6a378262cd\") " pod="openshift-ingress/e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b" Jul 11 01:49:11.718562 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:11.718519 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b366829-3755-421d-b5d8-4b6a378262cd-workload-socket\") pod \"e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b\" (UID: \"3b366829-3755-421d-b5d8-4b6a378262cd\") " pod="openshift-ingress/e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b" Jul 11 01:49:11.718562 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:11.718565 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b366829-3755-421d-b5d8-4b6a378262cd-workload-certs\") pod \"e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b\" (UID: \"3b366829-3755-421d-b5d8-4b6a378262cd\") " pod="openshift-ingress/e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b" Jul 11 01:49:11.719141 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:11.718598 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b366829-3755-421d-b5d8-4b6a378262cd-istio-podinfo\") pod \"e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b\" (UID: \"3b366829-3755-421d-b5d8-4b6a378262cd\") " pod="openshift-ingress/e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b" Jul 11 01:49:11.719141 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:11.718622 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b366829-3755-421d-b5d8-4b6a378262cd-istiod-ca-cert\") pod \"e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b\" (UID: \"3b366829-3755-421d-b5d8-4b6a378262cd\") " pod="openshift-ingress/e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b" Jul 11 01:49:11.719141 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:11.718647 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b366829-3755-421d-b5d8-4b6a378262cd-istio-envoy\") pod \"e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b\" (UID: \"3b366829-3755-421d-b5d8-4b6a378262cd\") " pod="openshift-ingress/e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b" Jul 11 01:49:11.719141 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:11.718775 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79zz6\" (UniqueName: \"kubernetes.io/projected/3b366829-3755-421d-b5d8-4b6a378262cd-kube-api-access-79zz6\") pod \"e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b\" (UID: \"3b366829-3755-421d-b5d8-4b6a378262cd\") " pod="openshift-ingress/e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b" Jul 11 01:49:11.719141 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:11.718806 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b366829-3755-421d-b5d8-4b6a378262cd-istio-data\") pod \"e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b\" (UID: \"3b366829-3755-421d-b5d8-4b6a378262cd\") " pod="openshift-ingress/e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b" Jul 11 01:49:11.719141 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:11.718838 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b366829-3755-421d-b5d8-4b6a378262cd-credential-socket\") pod \"e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b\" (UID: \"3b366829-3755-421d-b5d8-4b6a378262cd\") " pod="openshift-ingress/e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b" Jul 11 01:49:11.719141 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:11.718919 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b366829-3755-421d-b5d8-4b6a378262cd-istio-token\") pod \"e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b\" (UID: \"3b366829-3755-421d-b5d8-4b6a378262cd\") " pod="openshift-ingress/e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b" Jul 11 01:49:11.719141 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:11.719044 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b366829-3755-421d-b5d8-4b6a378262cd-workload-socket\") pod \"e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b\" (UID: \"3b366829-3755-421d-b5d8-4b6a378262cd\") " pod="openshift-ingress/e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b" Jul 11 01:49:11.719425 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:11.719167 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b366829-3755-421d-b5d8-4b6a378262cd-istio-data\") pod \"e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b\" (UID: \"3b366829-3755-421d-b5d8-4b6a378262cd\") " pod="openshift-ingress/e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b" Jul 11 01:49:11.719425 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:11.719344 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b366829-3755-421d-b5d8-4b6a378262cd-credential-socket\") pod \"e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b\" (UID: \"3b366829-3755-421d-b5d8-4b6a378262cd\") " pod="openshift-ingress/e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b" Jul 11 01:49:11.719425 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:11.719361 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b366829-3755-421d-b5d8-4b6a378262cd-workload-certs\") pod \"e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b\" (UID: \"3b366829-3755-421d-b5d8-4b6a378262cd\") " pod="openshift-ingress/e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b" Jul 11 01:49:11.719425 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:11.719411 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b366829-3755-421d-b5d8-4b6a378262cd-istiod-ca-cert\") pod \"e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b\" (UID: \"3b366829-3755-421d-b5d8-4b6a378262cd\") " pod="openshift-ingress/e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b" Jul 11 01:49:11.720986 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:11.720966 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b366829-3755-421d-b5d8-4b6a378262cd-istio-envoy\") pod \"e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b\" (UID: \"3b366829-3755-421d-b5d8-4b6a378262cd\") " pod="openshift-ingress/e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b" Jul 11 01:49:11.721330 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:11.721309 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b366829-3755-421d-b5d8-4b6a378262cd-istio-podinfo\") pod \"e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b\" (UID: \"3b366829-3755-421d-b5d8-4b6a378262cd\") " pod="openshift-ingress/e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b" Jul 11 01:49:11.727770 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:11.727726 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b366829-3755-421d-b5d8-4b6a378262cd-istio-token\") pod \"e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b\" (UID: \"3b366829-3755-421d-b5d8-4b6a378262cd\") " pod="openshift-ingress/e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b" Jul 11 01:49:11.727956 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:11.727923 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79zz6\" (UniqueName: \"kubernetes.io/projected/3b366829-3755-421d-b5d8-4b6a378262cd-kube-api-access-79zz6\") pod \"e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b\" (UID: \"3b366829-3755-421d-b5d8-4b6a378262cd\") " pod="openshift-ingress/e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b" Jul 11 01:49:11.827934 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:11.827834 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b" Jul 11 01:49:11.960953 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:11.960923 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b"] Jul 11 01:49:11.963328 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:49:11.963291 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b366829_3755_421d_b5d8_4b6a378262cd.slice/crio-51a4f84c0536d8adfd0fb1d1f7cd5e6eedda0297cfea6cd0a8710a3d0799bc0d WatchSource:0}: Error finding container 51a4f84c0536d8adfd0fb1d1f7cd5e6eedda0297cfea6cd0a8710a3d0799bc0d: Status 404 returned error can't find the container with id 51a4f84c0536d8adfd0fb1d1f7cd5e6eedda0297cfea6cd0a8710a3d0799bc0d Jul 11 01:49:11.965435 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:11.965400 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:49:11.965518 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:11.965466 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:49:11.965518 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:11.965494 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:49:12.363111 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:12.363076 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b" event={"ID":"3b366829-3755-421d-b5d8-4b6a378262cd","Type":"ContainerStarted","Data":"bcb6775043925259fee4b597f7aafb13fc93c62960682a401693aaf69c8d3807"} Jul 11 01:49:12.363290 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:12.363132 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b" event={"ID":"3b366829-3755-421d-b5d8-4b6a378262cd","Type":"ContainerStarted","Data":"51a4f84c0536d8adfd0fb1d1f7cd5e6eedda0297cfea6cd0a8710a3d0799bc0d"} Jul 11 01:49:12.383659 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:12.383606 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b" podStartSLOduration=1.3835914790000001 podStartE2EDuration="1.383591479s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:49:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:49:12.382627373 +0000 UTC m=+2556.714102939" watchObservedRunningTime="2026-07-11 01:49:12.383591479 +0000 UTC m=+2556.715067022" Jul 11 01:49:12.828515 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:12.828474 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b" Jul 11 01:49:13.833255 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:13.833219 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b" Jul 11 01:49:14.372461 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:14.372426 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b" Jul 11 01:49:14.373288 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:14.373272 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b" Jul 11 01:49:15.872633 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:15.872611 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw" Jul 11 01:49:15.957754 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:15.957685 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/644ad741-5f3c-409f-ab3c-51f0a892602c-istiod-ca-cert\") pod \"644ad741-5f3c-409f-ab3c-51f0a892602c\" (UID: \"644ad741-5f3c-409f-ab3c-51f0a892602c\") " Jul 11 01:49:15.957956 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:15.957765 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/644ad741-5f3c-409f-ab3c-51f0a892602c-istio-envoy\") pod \"644ad741-5f3c-409f-ab3c-51f0a892602c\" (UID: \"644ad741-5f3c-409f-ab3c-51f0a892602c\") " Jul 11 01:49:15.957956 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:15.957849 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2hcrw\" (UniqueName: \"kubernetes.io/projected/644ad741-5f3c-409f-ab3c-51f0a892602c-kube-api-access-2hcrw\") pod \"644ad741-5f3c-409f-ab3c-51f0a892602c\" (UID: \"644ad741-5f3c-409f-ab3c-51f0a892602c\") " Jul 11 01:49:15.957956 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:15.957874 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/644ad741-5f3c-409f-ab3c-51f0a892602c-istio-data\") pod \"644ad741-5f3c-409f-ab3c-51f0a892602c\" (UID: \"644ad741-5f3c-409f-ab3c-51f0a892602c\") " Jul 11 01:49:15.957956 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:15.957899 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/644ad741-5f3c-409f-ab3c-51f0a892602c-istio-token\") pod \"644ad741-5f3c-409f-ab3c-51f0a892602c\" (UID: \"644ad741-5f3c-409f-ab3c-51f0a892602c\") " Jul 11 01:49:15.957956 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:15.957941 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/644ad741-5f3c-409f-ab3c-51f0a892602c-istio-podinfo\") pod \"644ad741-5f3c-409f-ab3c-51f0a892602c\" (UID: \"644ad741-5f3c-409f-ab3c-51f0a892602c\") " Jul 11 01:49:15.958212 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:15.957968 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/644ad741-5f3c-409f-ab3c-51f0a892602c-credential-socket\") pod \"644ad741-5f3c-409f-ab3c-51f0a892602c\" (UID: \"644ad741-5f3c-409f-ab3c-51f0a892602c\") " Jul 11 01:49:15.958212 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:15.957995 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/644ad741-5f3c-409f-ab3c-51f0a892602c-workload-certs\") pod \"644ad741-5f3c-409f-ab3c-51f0a892602c\" (UID: \"644ad741-5f3c-409f-ab3c-51f0a892602c\") " Jul 11 01:49:15.958212 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:15.958027 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/644ad741-5f3c-409f-ab3c-51f0a892602c-workload-socket\") pod \"644ad741-5f3c-409f-ab3c-51f0a892602c\" (UID: \"644ad741-5f3c-409f-ab3c-51f0a892602c\") " Jul 11 01:49:15.958349 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:15.958142 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/644ad741-5f3c-409f-ab3c-51f0a892602c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "644ad741-5f3c-409f-ab3c-51f0a892602c" (UID: "644ad741-5f3c-409f-ab3c-51f0a892602c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 11 01:49:15.958349 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:15.958325 2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/644ad741-5f3c-409f-ab3c-51f0a892602c-istiod-ca-cert\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:49:15.958455 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:15.958418 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/644ad741-5f3c-409f-ab3c-51f0a892602c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "644ad741-5f3c-409f-ab3c-51f0a892602c" (UID: "644ad741-5f3c-409f-ab3c-51f0a892602c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 01:49:15.958512 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:15.958472 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/644ad741-5f3c-409f-ab3c-51f0a892602c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "644ad741-5f3c-409f-ab3c-51f0a892602c" (UID: "644ad741-5f3c-409f-ab3c-51f0a892602c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 01:49:15.958591 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:15.958560 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/644ad741-5f3c-409f-ab3c-51f0a892602c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "644ad741-5f3c-409f-ab3c-51f0a892602c" (UID: "644ad741-5f3c-409f-ab3c-51f0a892602c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 01:49:15.958996 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:15.958973 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/644ad741-5f3c-409f-ab3c-51f0a892602c-istio-data" (OuterVolumeSpecName: "istio-data") pod "644ad741-5f3c-409f-ab3c-51f0a892602c" (UID: "644ad741-5f3c-409f-ab3c-51f0a892602c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 01:49:15.960250 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:15.960228 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/644ad741-5f3c-409f-ab3c-51f0a892602c-kube-api-access-2hcrw" (OuterVolumeSpecName: "kube-api-access-2hcrw") pod "644ad741-5f3c-409f-ab3c-51f0a892602c" (UID: "644ad741-5f3c-409f-ab3c-51f0a892602c"). InnerVolumeSpecName "kube-api-access-2hcrw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 11 01:49:15.960349 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:15.960258 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/644ad741-5f3c-409f-ab3c-51f0a892602c-istio-token" (OuterVolumeSpecName: "istio-token") pod "644ad741-5f3c-409f-ab3c-51f0a892602c" (UID: "644ad741-5f3c-409f-ab3c-51f0a892602c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 11 01:49:15.960430 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:15.960412 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/644ad741-5f3c-409f-ab3c-51f0a892602c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "644ad741-5f3c-409f-ab3c-51f0a892602c" (UID: "644ad741-5f3c-409f-ab3c-51f0a892602c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 11 01:49:15.960559 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:15.960545 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/644ad741-5f3c-409f-ab3c-51f0a892602c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "644ad741-5f3c-409f-ab3c-51f0a892602c" (UID: "644ad741-5f3c-409f-ab3c-51f0a892602c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 01:49:16.059188 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:16.059152 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2hcrw\" (UniqueName: \"kubernetes.io/projected/644ad741-5f3c-409f-ab3c-51f0a892602c-kube-api-access-2hcrw\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:49:16.059188 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:16.059183 2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/644ad741-5f3c-409f-ab3c-51f0a892602c-istio-data\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:49:16.059188 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:16.059194 2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/644ad741-5f3c-409f-ab3c-51f0a892602c-istio-token\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:49:16.059188 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:16.059202 2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/644ad741-5f3c-409f-ab3c-51f0a892602c-istio-podinfo\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:49:16.059449 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:16.059210 2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/644ad741-5f3c-409f-ab3c-51f0a892602c-credential-socket\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:49:16.059449 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:16.059219 2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/644ad741-5f3c-409f-ab3c-51f0a892602c-workload-certs\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:49:16.059449 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:16.059227 2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/644ad741-5f3c-409f-ab3c-51f0a892602c-workload-socket\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:49:16.059449 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:16.059235 2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/644ad741-5f3c-409f-ab3c-51f0a892602c-istio-envoy\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:49:16.382950 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:16.382918 2572 generic.go:356] "Generic (PLEG): container finished" podID="644ad741-5f3c-409f-ab3c-51f0a892602c" containerID="66c9ed07e39c2ac4509e757033531aa3d86b952756b1fd24b9dbcb0a9e48698a" exitCode=0 Jul 11 01:49:16.383119 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:16.382974 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw" Jul 11 01:49:16.383119 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:16.383004 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw" event={"ID":"644ad741-5f3c-409f-ab3c-51f0a892602c","Type":"ContainerDied","Data":"66c9ed07e39c2ac4509e757033531aa3d86b952756b1fd24b9dbcb0a9e48698a"} Jul 11 01:49:16.383119 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:16.383059 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw" event={"ID":"644ad741-5f3c-409f-ab3c-51f0a892602c","Type":"ContainerDied","Data":"0781e96f71d3adc1a16a5b10c0def6ba97c49737c8d16ac8496c207fc78412a6"} Jul 11 01:49:16.383119 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:16.383083 2572 scope.go:117] "RemoveContainer" containerID="66c9ed07e39c2ac4509e757033531aa3d86b952756b1fd24b9dbcb0a9e48698a" Jul 11 01:49:16.397623 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:16.397599 2572 scope.go:117] "RemoveContainer" containerID="d37f9afdf24d763212ef5636e076aba363374e1d25e27b59e013fc05c0ed49aa" Jul 11 01:49:16.400856 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:16.400832 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw"] Jul 11 01:49:16.404511 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:16.404483 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-1e79cd-openshift-default-64d5f94745-zjqmw"] Jul 11 01:49:16.406083 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:16.406067 2572 scope.go:117] "RemoveContainer" containerID="66c9ed07e39c2ac4509e757033531aa3d86b952756b1fd24b9dbcb0a9e48698a" Jul 11 01:49:16.406366 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:49:16.406346 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66c9ed07e39c2ac4509e757033531aa3d86b952756b1fd24b9dbcb0a9e48698a\": container with ID starting with 66c9ed07e39c2ac4509e757033531aa3d86b952756b1fd24b9dbcb0a9e48698a not found: ID does not exist" containerID="66c9ed07e39c2ac4509e757033531aa3d86b952756b1fd24b9dbcb0a9e48698a" Jul 11 01:49:16.406409 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:16.406375 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66c9ed07e39c2ac4509e757033531aa3d86b952756b1fd24b9dbcb0a9e48698a"} err="failed to get container status \"66c9ed07e39c2ac4509e757033531aa3d86b952756b1fd24b9dbcb0a9e48698a\": rpc error: code = NotFound desc = could not find container \"66c9ed07e39c2ac4509e757033531aa3d86b952756b1fd24b9dbcb0a9e48698a\": container with ID starting with 66c9ed07e39c2ac4509e757033531aa3d86b952756b1fd24b9dbcb0a9e48698a not found: ID does not exist" Jul 11 01:49:16.406409 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:16.406394 2572 scope.go:117] "RemoveContainer" containerID="d37f9afdf24d763212ef5636e076aba363374e1d25e27b59e013fc05c0ed49aa" Jul 11 01:49:16.406634 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:49:16.406617 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d37f9afdf24d763212ef5636e076aba363374e1d25e27b59e013fc05c0ed49aa\": container with ID starting with d37f9afdf24d763212ef5636e076aba363374e1d25e27b59e013fc05c0ed49aa not found: ID does not exist" containerID="d37f9afdf24d763212ef5636e076aba363374e1d25e27b59e013fc05c0ed49aa" Jul 11 01:49:16.406693 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:16.406642 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d37f9afdf24d763212ef5636e076aba363374e1d25e27b59e013fc05c0ed49aa"} err="failed to get container status \"d37f9afdf24d763212ef5636e076aba363374e1d25e27b59e013fc05c0ed49aa\": rpc error: code = NotFound desc = could not find container \"d37f9afdf24d763212ef5636e076aba363374e1d25e27b59e013fc05c0ed49aa\": container with ID starting with d37f9afdf24d763212ef5636e076aba363374e1d25e27b59e013fc05c0ed49aa not found: ID does not exist" Jul 11 01:49:18.256716 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:18.256672 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="644ad741-5f3c-409f-ab3c-51f0a892602c" path="/var/lib/kubelet/pods/644ad741-5f3c-409f-ab3c-51f0a892602c/volumes" Jul 11 01:49:19.450575 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:19.450536 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs"] Jul 11 01:49:19.451043 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:19.450866 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="644ad741-5f3c-409f-ab3c-51f0a892602c" containerName="istio-proxy" Jul 11 01:49:19.451043 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:19.450882 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="644ad741-5f3c-409f-ab3c-51f0a892602c" containerName="istio-proxy" Jul 11 01:49:19.451043 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:19.450900 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c" containerName="istio-proxy" Jul 11 01:49:19.451043 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:19.450906 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c" containerName="istio-proxy" Jul 11 01:49:19.451043 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:19.450956 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="644ad741-5f3c-409f-ab3c-51f0a892602c" containerName="istio-proxy" Jul 11 01:49:19.451043 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:19.450965 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfbd3cad-fbf9-4883-8bb0-0dbba3e1728c" containerName="istio-proxy" Jul 11 01:49:19.455467 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:19.455443 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs" Jul 11 01:49:19.457853 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:19.457833 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-124c39-openshift-default-dockercfg-msnl2\"" Jul 11 01:49:19.466606 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:19.466583 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs"] Jul 11 01:49:19.590914 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:19.590880 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6ba1d17-5a8a-4977-8226-0e4658d1d759-istio-podinfo\") pod \"e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs\" (UID: \"b6ba1d17-5a8a-4977-8226-0e4658d1d759\") " pod="openshift-ingress/e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs" Jul 11 01:49:19.591086 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:19.590931 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6ba1d17-5a8a-4977-8226-0e4658d1d759-workload-certs\") pod \"e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs\" (UID: \"b6ba1d17-5a8a-4977-8226-0e4658d1d759\") " pod="openshift-ingress/e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs" Jul 11 01:49:19.591086 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:19.590982 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6ba1d17-5a8a-4977-8226-0e4658d1d759-istiod-ca-cert\") pod \"e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs\" (UID: \"b6ba1d17-5a8a-4977-8226-0e4658d1d759\") " pod="openshift-ingress/e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs" Jul 11 01:49:19.591086 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:19.591028 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6ba1d17-5a8a-4977-8226-0e4658d1d759-istio-envoy\") pod \"e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs\" (UID: \"b6ba1d17-5a8a-4977-8226-0e4658d1d759\") " pod="openshift-ingress/e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs" Jul 11 01:49:19.591086 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:19.591067 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6ba1d17-5a8a-4977-8226-0e4658d1d759-workload-socket\") pod \"e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs\" (UID: \"b6ba1d17-5a8a-4977-8226-0e4658d1d759\") " pod="openshift-ingress/e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs" Jul 11 01:49:19.591234 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:19.591088 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6ba1d17-5a8a-4977-8226-0e4658d1d759-istio-token\") pod \"e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs\" (UID: \"b6ba1d17-5a8a-4977-8226-0e4658d1d759\") " pod="openshift-ingress/e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs" Jul 11 01:49:19.591234 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:19.591110 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nx5vg\" (UniqueName: \"kubernetes.io/projected/b6ba1d17-5a8a-4977-8226-0e4658d1d759-kube-api-access-nx5vg\") pod \"e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs\" (UID: \"b6ba1d17-5a8a-4977-8226-0e4658d1d759\") " pod="openshift-ingress/e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs" Jul 11 01:49:19.591234 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:19.591142 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6ba1d17-5a8a-4977-8226-0e4658d1d759-credential-socket\") pod \"e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs\" (UID: \"b6ba1d17-5a8a-4977-8226-0e4658d1d759\") " pod="openshift-ingress/e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs" Jul 11 01:49:19.591234 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:19.591160 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6ba1d17-5a8a-4977-8226-0e4658d1d759-istio-data\") pod \"e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs\" (UID: \"b6ba1d17-5a8a-4977-8226-0e4658d1d759\") " pod="openshift-ingress/e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs" Jul 11 01:49:19.691928 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:19.691878 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6ba1d17-5a8a-4977-8226-0e4658d1d759-istiod-ca-cert\") pod \"e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs\" (UID: \"b6ba1d17-5a8a-4977-8226-0e4658d1d759\") " pod="openshift-ingress/e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs" Jul 11 01:49:19.692083 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:19.691943 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6ba1d17-5a8a-4977-8226-0e4658d1d759-istio-envoy\") pod \"e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs\" (UID: \"b6ba1d17-5a8a-4977-8226-0e4658d1d759\") " pod="openshift-ingress/e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs" Jul 11 01:49:19.692083 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:19.691983 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6ba1d17-5a8a-4977-8226-0e4658d1d759-workload-socket\") pod \"e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs\" (UID: \"b6ba1d17-5a8a-4977-8226-0e4658d1d759\") " pod="openshift-ingress/e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs" Jul 11 01:49:19.692083 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:19.692013 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6ba1d17-5a8a-4977-8226-0e4658d1d759-istio-token\") pod \"e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs\" (UID: \"b6ba1d17-5a8a-4977-8226-0e4658d1d759\") " pod="openshift-ingress/e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs" Jul 11 01:49:19.692083 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:19.692036 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nx5vg\" (UniqueName: \"kubernetes.io/projected/b6ba1d17-5a8a-4977-8226-0e4658d1d759-kube-api-access-nx5vg\") pod \"e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs\" (UID: \"b6ba1d17-5a8a-4977-8226-0e4658d1d759\") " pod="openshift-ingress/e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs" Jul 11 01:49:19.692083 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:19.692071 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6ba1d17-5a8a-4977-8226-0e4658d1d759-credential-socket\") pod \"e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs\" (UID: \"b6ba1d17-5a8a-4977-8226-0e4658d1d759\") " pod="openshift-ingress/e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs" Jul 11 01:49:19.692326 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:19.692092 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6ba1d17-5a8a-4977-8226-0e4658d1d759-istio-data\") pod \"e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs\" (UID: \"b6ba1d17-5a8a-4977-8226-0e4658d1d759\") " pod="openshift-ingress/e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs" Jul 11 01:49:19.692326 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:19.692151 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6ba1d17-5a8a-4977-8226-0e4658d1d759-istio-podinfo\") pod \"e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs\" (UID: \"b6ba1d17-5a8a-4977-8226-0e4658d1d759\") " pod="openshift-ingress/e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs" Jul 11 01:49:19.692326 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:19.692203 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6ba1d17-5a8a-4977-8226-0e4658d1d759-workload-certs\") pod \"e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs\" (UID: \"b6ba1d17-5a8a-4977-8226-0e4658d1d759\") " pod="openshift-ingress/e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs" Jul 11 01:49:19.692519 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:19.692486 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6ba1d17-5a8a-4977-8226-0e4658d1d759-workload-socket\") pod \"e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs\" (UID: \"b6ba1d17-5a8a-4977-8226-0e4658d1d759\") " pod="openshift-ingress/e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs" Jul 11 01:49:19.692580 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:19.692490 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6ba1d17-5a8a-4977-8226-0e4658d1d759-credential-socket\") pod \"e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs\" (UID: \"b6ba1d17-5a8a-4977-8226-0e4658d1d759\") " pod="openshift-ingress/e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs" Jul 11 01:49:19.692580 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:19.692550 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6ba1d17-5a8a-4977-8226-0e4658d1d759-workload-certs\") pod \"e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs\" (UID: \"b6ba1d17-5a8a-4977-8226-0e4658d1d759\") " pod="openshift-ingress/e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs" Jul 11 01:49:19.692680 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:19.692626 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6ba1d17-5a8a-4977-8226-0e4658d1d759-istio-data\") pod \"e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs\" (UID: \"b6ba1d17-5a8a-4977-8226-0e4658d1d759\") " pod="openshift-ingress/e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs" Jul 11 01:49:19.692761 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:19.692730 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6ba1d17-5a8a-4977-8226-0e4658d1d759-istiod-ca-cert\") pod \"e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs\" (UID: \"b6ba1d17-5a8a-4977-8226-0e4658d1d759\") " pod="openshift-ingress/e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs" Jul 11 01:49:19.694569 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:19.694542 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6ba1d17-5a8a-4977-8226-0e4658d1d759-istio-envoy\") pod \"e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs\" (UID: \"b6ba1d17-5a8a-4977-8226-0e4658d1d759\") " pod="openshift-ingress/e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs" Jul 11 01:49:19.694959 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:19.694939 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6ba1d17-5a8a-4977-8226-0e4658d1d759-istio-podinfo\") pod \"e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs\" (UID: \"b6ba1d17-5a8a-4977-8226-0e4658d1d759\") " pod="openshift-ingress/e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs" Jul 11 01:49:19.699713 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:19.699677 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6ba1d17-5a8a-4977-8226-0e4658d1d759-istio-token\") pod \"e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs\" (UID: \"b6ba1d17-5a8a-4977-8226-0e4658d1d759\") " pod="openshift-ingress/e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs" Jul 11 01:49:19.699912 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:19.699897 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nx5vg\" (UniqueName: \"kubernetes.io/projected/b6ba1d17-5a8a-4977-8226-0e4658d1d759-kube-api-access-nx5vg\") pod \"e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs\" (UID: \"b6ba1d17-5a8a-4977-8226-0e4658d1d759\") " pod="openshift-ingress/e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs" Jul 11 01:49:19.764981 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:19.764882 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs" Jul 11 01:49:19.906747 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:19.906716 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs"] Jul 11 01:49:19.909420 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:49:19.909392 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6ba1d17_5a8a_4977_8226_0e4658d1d759.slice/crio-3249c2b212ec2fcbade5091d008233e02b6cd8d2745ba0ad4e3b4e3ed00759a3 WatchSource:0}: Error finding container 3249c2b212ec2fcbade5091d008233e02b6cd8d2745ba0ad4e3b4e3ed00759a3: Status 404 returned error can't find the container with id 3249c2b212ec2fcbade5091d008233e02b6cd8d2745ba0ad4e3b4e3ed00759a3 Jul 11 01:49:19.911559 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:19.911523 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:49:19.911636 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:19.911608 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:49:19.911675 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:19.911647 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:49:20.402911 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:20.402875 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs" event={"ID":"b6ba1d17-5a8a-4977-8226-0e4658d1d759","Type":"ContainerStarted","Data":"41f39f05181bd1b78398ab4e44dcf5e3a65ec7017f0685050ab383b34000ed00"} Jul 11 01:49:20.403088 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:20.402928 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs" event={"ID":"b6ba1d17-5a8a-4977-8226-0e4658d1d759","Type":"ContainerStarted","Data":"3249c2b212ec2fcbade5091d008233e02b6cd8d2745ba0ad4e3b4e3ed00759a3"} Jul 11 01:49:20.423170 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:20.423113 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs" podStartSLOduration=1.423096984 podStartE2EDuration="1.423096984s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:49:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:49:20.420778152 +0000 UTC m=+2564.752253726" watchObservedRunningTime="2026-07-11 01:49:20.423096984 +0000 UTC m=+2564.754572529" Jul 11 01:49:20.765348 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:20.765307 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs" Jul 11 01:49:20.770398 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:20.770371 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs" Jul 11 01:49:21.407280 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:21.407247 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs" Jul 11 01:49:21.408072 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:21.408053 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs" Jul 11 01:49:30.078930 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:30.077838 2572 patch_prober.go:28] interesting pod/e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": read tcp 10.134.0.2:39094->10.134.0.31:15021: read: connection reset by peer" start-of-body= Jul 11 01:49:30.078930 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:30.077923 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b" podUID="3b366829-3755-421d-b5d8-4b6a378262cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": read tcp 10.134.0.2:39094->10.134.0.31:15021: read: connection reset by peer" Jul 11 01:49:30.446935 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:30.446899 2572 generic.go:356] "Generic (PLEG): container finished" podID="3b366829-3755-421d-b5d8-4b6a378262cd" containerID="bcb6775043925259fee4b597f7aafb13fc93c62960682a401693aaf69c8d3807" exitCode=0 Jul 11 01:49:30.447122 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:30.446973 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b" event={"ID":"3b366829-3755-421d-b5d8-4b6a378262cd","Type":"ContainerDied","Data":"bcb6775043925259fee4b597f7aafb13fc93c62960682a401693aaf69c8d3807"} Jul 11 01:49:30.447372 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:30.447358 2572 scope.go:117] "RemoveContainer" containerID="bcb6775043925259fee4b597f7aafb13fc93c62960682a401693aaf69c8d3807" Jul 11 01:49:30.448342 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:30.448316 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:49:30.448402 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:30.448386 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:49:30.448443 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:30.448419 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:49:31.455979 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:31.455933 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b" event={"ID":"3b366829-3755-421d-b5d8-4b6a378262cd","Type":"ContainerStarted","Data":"f18ae4f5e002a7dbc0a268ce18ef7a0cd01fb58136e03b062b28e3231488157b"} Jul 11 01:49:31.828808 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:31.828678 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b" Jul 11 01:49:31.828967 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:31.828931 2572 patch_prober.go:28] interesting pod/e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body= Jul 11 01:49:31.829009 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:31.828983 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b" podUID="3b366829-3755-421d-b5d8-4b6a378262cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" Jul 11 01:49:32.829136 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:32.829091 2572 patch_prober.go:28] interesting pod/e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body= Jul 11 01:49:32.829520 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:32.829159 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b" podUID="3b366829-3755-421d-b5d8-4b6a378262cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" Jul 11 01:49:33.828857 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:33.828821 2572 patch_prober.go:28] interesting pod/e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body= Jul 11 01:49:33.829094 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:33.829073 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b" podUID="3b366829-3755-421d-b5d8-4b6a378262cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" Jul 11 01:49:34.828481 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:34.828446 2572 patch_prober.go:28] interesting pod/e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body= Jul 11 01:49:34.828985 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:34.828956 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b" podUID="3b366829-3755-421d-b5d8-4b6a378262cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" Jul 11 01:49:35.831989 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:35.831907 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b" Jul 11 01:49:35.832376 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:35.832337 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b" Jul 11 01:49:35.833219 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:35.833199 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b" Jul 11 01:49:37.449921 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:37.449867 2572 patch_prober.go:28] interesting pod/e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 11 01:49:37.450426 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:37.449945 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs" podUID="b6ba1d17-5a8a-4977-8226-0e4658d1d759" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 11 01:49:38.493250 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:38.493216 2572 generic.go:356] "Generic (PLEG): container finished" podID="b6ba1d17-5a8a-4977-8226-0e4658d1d759" containerID="41f39f05181bd1b78398ab4e44dcf5e3a65ec7017f0685050ab383b34000ed00" exitCode=0 Jul 11 01:49:38.493657 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:38.493291 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs" event={"ID":"b6ba1d17-5a8a-4977-8226-0e4658d1d759","Type":"ContainerDied","Data":"41f39f05181bd1b78398ab4e44dcf5e3a65ec7017f0685050ab383b34000ed00"} Jul 11 01:49:38.493785 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:38.493764 2572 scope.go:117] "RemoveContainer" containerID="41f39f05181bd1b78398ab4e44dcf5e3a65ec7017f0685050ab383b34000ed00" Jul 11 01:49:38.494766 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:38.494739 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:49:38.494824 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:38.494812 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:49:38.494860 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:38.494847 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:49:39.499830 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:39.499793 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs" event={"ID":"b6ba1d17-5a8a-4977-8226-0e4658d1d759","Type":"ContainerStarted","Data":"5e1053207164fd3947732b98eb6c620ee850bc12aa454e218eb0208ec64f3da5"} Jul 11 01:49:39.765845 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:39.765752 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs" Jul 11 01:49:39.766073 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:39.766044 2572 patch_prober.go:28] interesting pod/e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body= Jul 11 01:49:39.766123 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:39.766103 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs" podUID="b6ba1d17-5a8a-4977-8226-0e4658d1d759" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" Jul 11 01:49:40.765648 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:40.765613 2572 patch_prober.go:28] interesting pod/e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body= Jul 11 01:49:40.766099 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:40.765672 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs" podUID="b6ba1d17-5a8a-4977-8226-0e4658d1d759" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" Jul 11 01:49:41.765786 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:41.765744 2572 patch_prober.go:28] interesting pod/e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body= Jul 11 01:49:41.766295 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:41.765820 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs" podUID="b6ba1d17-5a8a-4977-8226-0e4658d1d759" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" Jul 11 01:49:42.766108 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:42.766071 2572 patch_prober.go:28] interesting pod/e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body= Jul 11 01:49:42.766532 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:42.766128 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs" podUID="b6ba1d17-5a8a-4977-8226-0e4658d1d759" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" Jul 11 01:49:43.768967 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:43.768934 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs" Jul 11 01:49:43.769441 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:43.769213 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs" Jul 11 01:49:43.770009 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:49:43.769991 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs" Jul 11 01:50:00.594495 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:00.594459 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b"] Jul 11 01:50:00.595368 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:00.594735 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b" podUID="3b366829-3755-421d-b5d8-4b6a378262cd" containerName="istio-proxy" containerID="cri-o://f18ae4f5e002a7dbc0a268ce18ef7a0cd01fb58136e03b062b28e3231488157b" gracePeriod=30 Jul 11 01:50:05.844808 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:05.844779 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b" Jul 11 01:50:06.025206 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:06.025166 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b366829-3755-421d-b5d8-4b6a378262cd-workload-socket\") pod \"3b366829-3755-421d-b5d8-4b6a378262cd\" (UID: \"3b366829-3755-421d-b5d8-4b6a378262cd\") " Jul 11 01:50:06.025206 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:06.025211 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b366829-3755-421d-b5d8-4b6a378262cd-credential-socket\") pod \"3b366829-3755-421d-b5d8-4b6a378262cd\" (UID: \"3b366829-3755-421d-b5d8-4b6a378262cd\") " Jul 11 01:50:06.025482 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:06.025230 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b366829-3755-421d-b5d8-4b6a378262cd-istio-token\") pod \"3b366829-3755-421d-b5d8-4b6a378262cd\" (UID: \"3b366829-3755-421d-b5d8-4b6a378262cd\") " Jul 11 01:50:06.025482 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:06.025246 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b366829-3755-421d-b5d8-4b6a378262cd-istio-envoy\") pod \"3b366829-3755-421d-b5d8-4b6a378262cd\" (UID: \"3b366829-3755-421d-b5d8-4b6a378262cd\") " Jul 11 01:50:06.025482 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:06.025266 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-79zz6\" (UniqueName: \"kubernetes.io/projected/3b366829-3755-421d-b5d8-4b6a378262cd-kube-api-access-79zz6\") pod \"3b366829-3755-421d-b5d8-4b6a378262cd\" (UID: \"3b366829-3755-421d-b5d8-4b6a378262cd\") " Jul 11 01:50:06.025482 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:06.025311 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b366829-3755-421d-b5d8-4b6a378262cd-istiod-ca-cert\") pod \"3b366829-3755-421d-b5d8-4b6a378262cd\" (UID: \"3b366829-3755-421d-b5d8-4b6a378262cd\") " Jul 11 01:50:06.025482 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:06.025343 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b366829-3755-421d-b5d8-4b6a378262cd-istio-podinfo\") pod \"3b366829-3755-421d-b5d8-4b6a378262cd\" (UID: \"3b366829-3755-421d-b5d8-4b6a378262cd\") " Jul 11 01:50:06.025482 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:06.025379 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b366829-3755-421d-b5d8-4b6a378262cd-workload-certs\") pod \"3b366829-3755-421d-b5d8-4b6a378262cd\" (UID: \"3b366829-3755-421d-b5d8-4b6a378262cd\") " Jul 11 01:50:06.025482 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:06.025435 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b366829-3755-421d-b5d8-4b6a378262cd-istio-data\") pod \"3b366829-3755-421d-b5d8-4b6a378262cd\" (UID: \"3b366829-3755-421d-b5d8-4b6a378262cd\") " Jul 11 01:50:06.025903 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:06.025494 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b366829-3755-421d-b5d8-4b6a378262cd-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3b366829-3755-421d-b5d8-4b6a378262cd" (UID: "3b366829-3755-421d-b5d8-4b6a378262cd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 01:50:06.025903 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:06.025661 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b366829-3755-421d-b5d8-4b6a378262cd-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3b366829-3755-421d-b5d8-4b6a378262cd" (UID: "3b366829-3755-421d-b5d8-4b6a378262cd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 01:50:06.025903 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:06.025763 2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b366829-3755-421d-b5d8-4b6a378262cd-workload-socket\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:50:06.025903 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:06.025870 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b366829-3755-421d-b5d8-4b6a378262cd-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3b366829-3755-421d-b5d8-4b6a378262cd" (UID: "3b366829-3755-421d-b5d8-4b6a378262cd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 01:50:06.025903 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:06.025879 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b366829-3755-421d-b5d8-4b6a378262cd-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3b366829-3755-421d-b5d8-4b6a378262cd" (UID: "3b366829-3755-421d-b5d8-4b6a378262cd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 11 01:50:06.026601 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:06.026580 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b366829-3755-421d-b5d8-4b6a378262cd-istio-data" (OuterVolumeSpecName: "istio-data") pod "3b366829-3755-421d-b5d8-4b6a378262cd" (UID: "3b366829-3755-421d-b5d8-4b6a378262cd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 01:50:06.028015 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:06.027987 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b366829-3755-421d-b5d8-4b6a378262cd-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3b366829-3755-421d-b5d8-4b6a378262cd" (UID: "3b366829-3755-421d-b5d8-4b6a378262cd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 01:50:06.028015 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:06.028003 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b366829-3755-421d-b5d8-4b6a378262cd-istio-token" (OuterVolumeSpecName: "istio-token") pod "3b366829-3755-421d-b5d8-4b6a378262cd" (UID: "3b366829-3755-421d-b5d8-4b6a378262cd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 11 01:50:06.028181 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:06.028144 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b366829-3755-421d-b5d8-4b6a378262cd-kube-api-access-79zz6" (OuterVolumeSpecName: "kube-api-access-79zz6") pod "3b366829-3755-421d-b5d8-4b6a378262cd" (UID: "3b366829-3755-421d-b5d8-4b6a378262cd"). InnerVolumeSpecName "kube-api-access-79zz6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 11 01:50:06.028181 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:06.028151 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3b366829-3755-421d-b5d8-4b6a378262cd-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3b366829-3755-421d-b5d8-4b6a378262cd" (UID: "3b366829-3755-421d-b5d8-4b6a378262cd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 11 01:50:06.126944 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:06.126906 2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b366829-3755-421d-b5d8-4b6a378262cd-istio-data\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:50:06.126944 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:06.126938 2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b366829-3755-421d-b5d8-4b6a378262cd-credential-socket\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:50:06.126944 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:06.126948 2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b366829-3755-421d-b5d8-4b6a378262cd-istio-token\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:50:06.126944 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:06.126957 2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b366829-3755-421d-b5d8-4b6a378262cd-istio-envoy\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:50:06.127291 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:06.126965 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-79zz6\" (UniqueName: \"kubernetes.io/projected/3b366829-3755-421d-b5d8-4b6a378262cd-kube-api-access-79zz6\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:50:06.127291 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:06.126973 2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b366829-3755-421d-b5d8-4b6a378262cd-istiod-ca-cert\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:50:06.127291 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:06.126981 2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b366829-3755-421d-b5d8-4b6a378262cd-istio-podinfo\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:50:06.127291 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:06.126988 2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b366829-3755-421d-b5d8-4b6a378262cd-workload-certs\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:50:06.621442 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:06.621406 2572 generic.go:356] "Generic (PLEG): container finished" podID="3b366829-3755-421d-b5d8-4b6a378262cd" containerID="f18ae4f5e002a7dbc0a268ce18ef7a0cd01fb58136e03b062b28e3231488157b" exitCode=0 Jul 11 01:50:06.621645 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:06.621460 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b" Jul 11 01:50:06.621645 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:06.621492 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b" event={"ID":"3b366829-3755-421d-b5d8-4b6a378262cd","Type":"ContainerDied","Data":"f18ae4f5e002a7dbc0a268ce18ef7a0cd01fb58136e03b062b28e3231488157b"} Jul 11 01:50:06.621645 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:06.621559 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b" event={"ID":"3b366829-3755-421d-b5d8-4b6a378262cd","Type":"ContainerDied","Data":"51a4f84c0536d8adfd0fb1d1f7cd5e6eedda0297cfea6cd0a8710a3d0799bc0d"} Jul 11 01:50:06.621645 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:06.621590 2572 scope.go:117] "RemoveContainer" containerID="f18ae4f5e002a7dbc0a268ce18ef7a0cd01fb58136e03b062b28e3231488157b" Jul 11 01:50:06.630522 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:06.630500 2572 scope.go:117] "RemoveContainer" containerID="bcb6775043925259fee4b597f7aafb13fc93c62960682a401693aaf69c8d3807" Jul 11 01:50:06.639044 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:06.639016 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b"] Jul 11 01:50:06.639370 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:06.639348 2572 scope.go:117] "RemoveContainer" containerID="f18ae4f5e002a7dbc0a268ce18ef7a0cd01fb58136e03b062b28e3231488157b" Jul 11 01:50:06.639639 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:50:06.639619 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f18ae4f5e002a7dbc0a268ce18ef7a0cd01fb58136e03b062b28e3231488157b\": container with ID starting with f18ae4f5e002a7dbc0a268ce18ef7a0cd01fb58136e03b062b28e3231488157b not found: ID does not exist" containerID="f18ae4f5e002a7dbc0a268ce18ef7a0cd01fb58136e03b062b28e3231488157b" Jul 11 01:50:06.639716 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:06.639648 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f18ae4f5e002a7dbc0a268ce18ef7a0cd01fb58136e03b062b28e3231488157b"} err="failed to get container status \"f18ae4f5e002a7dbc0a268ce18ef7a0cd01fb58136e03b062b28e3231488157b\": rpc error: code = NotFound desc = could not find container \"f18ae4f5e002a7dbc0a268ce18ef7a0cd01fb58136e03b062b28e3231488157b\": container with ID starting with f18ae4f5e002a7dbc0a268ce18ef7a0cd01fb58136e03b062b28e3231488157b not found: ID does not exist" Jul 11 01:50:06.639716 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:06.639665 2572 scope.go:117] "RemoveContainer" containerID="bcb6775043925259fee4b597f7aafb13fc93c62960682a401693aaf69c8d3807" Jul 11 01:50:06.639911 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:50:06.639896 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bcb6775043925259fee4b597f7aafb13fc93c62960682a401693aaf69c8d3807\": container with ID starting with bcb6775043925259fee4b597f7aafb13fc93c62960682a401693aaf69c8d3807 not found: ID does not exist" containerID="bcb6775043925259fee4b597f7aafb13fc93c62960682a401693aaf69c8d3807" Jul 11 01:50:06.639957 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:06.639915 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcb6775043925259fee4b597f7aafb13fc93c62960682a401693aaf69c8d3807"} err="failed to get container status \"bcb6775043925259fee4b597f7aafb13fc93c62960682a401693aaf69c8d3807\": rpc error: code = NotFound desc = could not find container \"bcb6775043925259fee4b597f7aafb13fc93c62960682a401693aaf69c8d3807\": container with ID starting with bcb6775043925259fee4b597f7aafb13fc93c62960682a401693aaf69c8d3807 not found: ID does not exist" Jul 11 01:50:06.643871 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:06.643846 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b"] Jul 11 01:50:06.832822 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:06.832772 2572 patch_prober.go:28] interesting pod/e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 11 01:50:06.833035 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:06.832869 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-1e2f0c-openshift-default-5647df9bd5-2w59b" podUID="3b366829-3755-421d-b5d8-4b6a378262cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 11 01:50:08.262317 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:08.262282 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b366829-3755-421d-b5d8-4b6a378262cd" path="/var/lib/kubelet/pods/3b366829-3755-421d-b5d8-4b6a378262cd/volumes" Jul 11 01:50:26.731065 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:26.731028 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs"] Jul 11 01:50:26.731529 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:26.731304 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs" podUID="b6ba1d17-5a8a-4977-8226-0e4658d1d759" containerName="istio-proxy" containerID="cri-o://5e1053207164fd3947732b98eb6c620ee850bc12aa454e218eb0208ec64f3da5" gracePeriod=30 Jul 11 01:50:27.633460 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:27.633427 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq"] Jul 11 01:50:27.633833 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:27.633816 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b366829-3755-421d-b5d8-4b6a378262cd" containerName="istio-proxy" Jul 11 01:50:27.633833 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:27.633835 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b366829-3755-421d-b5d8-4b6a378262cd" containerName="istio-proxy" Jul 11 01:50:27.634009 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:27.633854 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b366829-3755-421d-b5d8-4b6a378262cd" containerName="istio-proxy" Jul 11 01:50:27.634009 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:27.633859 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b366829-3755-421d-b5d8-4b6a378262cd" containerName="istio-proxy" Jul 11 01:50:27.634009 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:27.633873 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="644ad741-5f3c-409f-ab3c-51f0a892602c" containerName="istio-proxy" Jul 11 01:50:27.634009 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:27.633881 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="644ad741-5f3c-409f-ab3c-51f0a892602c" containerName="istio-proxy" Jul 11 01:50:27.634009 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:27.633934 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b366829-3755-421d-b5d8-4b6a378262cd" containerName="istio-proxy" Jul 11 01:50:27.634009 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:27.633943 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="644ad741-5f3c-409f-ab3c-51f0a892602c" containerName="istio-proxy" Jul 11 01:50:27.636905 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:27.636886 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq" Jul 11 01:50:27.639436 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:27.639418 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-696ed9-openshift-default-dockercfg-6g59s\"" Jul 11 01:50:27.649466 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:27.649442 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq"] Jul 11 01:50:27.717781 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:27.717741 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71be99a5-e0a0-4f53-b32f-52b173c4b030-workload-certs\") pod \"e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq\" (UID: \"71be99a5-e0a0-4f53-b32f-52b173c4b030\") " pod="openshift-ingress/e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq" Jul 11 01:50:27.717982 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:27.717831 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71be99a5-e0a0-4f53-b32f-52b173c4b030-istio-podinfo\") pod \"e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq\" (UID: \"71be99a5-e0a0-4f53-b32f-52b173c4b030\") " pod="openshift-ingress/e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq" Jul 11 01:50:27.717982 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:27.717864 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71be99a5-e0a0-4f53-b32f-52b173c4b030-workload-socket\") pod \"e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq\" (UID: \"71be99a5-e0a0-4f53-b32f-52b173c4b030\") " pod="openshift-ingress/e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq" Jul 11 01:50:27.717982 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:27.717891 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71be99a5-e0a0-4f53-b32f-52b173c4b030-istio-token\") pod \"e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq\" (UID: \"71be99a5-e0a0-4f53-b32f-52b173c4b030\") " pod="openshift-ingress/e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq" Jul 11 01:50:27.717982 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:27.717931 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71be99a5-e0a0-4f53-b32f-52b173c4b030-istio-envoy\") pod \"e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq\" (UID: \"71be99a5-e0a0-4f53-b32f-52b173c4b030\") " pod="openshift-ingress/e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq" Jul 11 01:50:27.718202 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:27.718013 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71be99a5-e0a0-4f53-b32f-52b173c4b030-istiod-ca-cert\") pod \"e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq\" (UID: \"71be99a5-e0a0-4f53-b32f-52b173c4b030\") " pod="openshift-ingress/e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq" Jul 11 01:50:27.718202 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:27.718072 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71be99a5-e0a0-4f53-b32f-52b173c4b030-istio-data\") pod \"e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq\" (UID: \"71be99a5-e0a0-4f53-b32f-52b173c4b030\") " pod="openshift-ingress/e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq" Jul 11 01:50:27.718202 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:27.718118 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71be99a5-e0a0-4f53-b32f-52b173c4b030-credential-socket\") pod \"e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq\" (UID: \"71be99a5-e0a0-4f53-b32f-52b173c4b030\") " pod="openshift-ingress/e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq" Jul 11 01:50:27.718202 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:27.718150 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gndg7\" (UniqueName: \"kubernetes.io/projected/71be99a5-e0a0-4f53-b32f-52b173c4b030-kube-api-access-gndg7\") pod \"e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq\" (UID: \"71be99a5-e0a0-4f53-b32f-52b173c4b030\") " pod="openshift-ingress/e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq" Jul 11 01:50:27.819256 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:27.819215 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71be99a5-e0a0-4f53-b32f-52b173c4b030-istiod-ca-cert\") pod \"e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq\" (UID: \"71be99a5-e0a0-4f53-b32f-52b173c4b030\") " pod="openshift-ingress/e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq" Jul 11 01:50:27.819778 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:27.819286 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71be99a5-e0a0-4f53-b32f-52b173c4b030-istio-data\") pod \"e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq\" (UID: \"71be99a5-e0a0-4f53-b32f-52b173c4b030\") " pod="openshift-ingress/e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq" Jul 11 01:50:27.819778 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:27.819324 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71be99a5-e0a0-4f53-b32f-52b173c4b030-credential-socket\") pod \"e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq\" (UID: \"71be99a5-e0a0-4f53-b32f-52b173c4b030\") " pod="openshift-ingress/e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq" Jul 11 01:50:27.819778 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:27.819349 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gndg7\" (UniqueName: \"kubernetes.io/projected/71be99a5-e0a0-4f53-b32f-52b173c4b030-kube-api-access-gndg7\") pod \"e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq\" (UID: \"71be99a5-e0a0-4f53-b32f-52b173c4b030\") " pod="openshift-ingress/e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq" Jul 11 01:50:27.819778 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:27.819467 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71be99a5-e0a0-4f53-b32f-52b173c4b030-workload-certs\") pod \"e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq\" (UID: \"71be99a5-e0a0-4f53-b32f-52b173c4b030\") " pod="openshift-ingress/e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq" Jul 11 01:50:27.819778 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:27.819531 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71be99a5-e0a0-4f53-b32f-52b173c4b030-istio-podinfo\") pod \"e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq\" (UID: \"71be99a5-e0a0-4f53-b32f-52b173c4b030\") " pod="openshift-ingress/e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq" Jul 11 01:50:27.819778 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:27.819557 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71be99a5-e0a0-4f53-b32f-52b173c4b030-workload-socket\") pod \"e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq\" (UID: \"71be99a5-e0a0-4f53-b32f-52b173c4b030\") " pod="openshift-ingress/e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq" Jul 11 01:50:27.819778 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:27.819590 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71be99a5-e0a0-4f53-b32f-52b173c4b030-istio-token\") pod \"e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq\" (UID: \"71be99a5-e0a0-4f53-b32f-52b173c4b030\") " pod="openshift-ingress/e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq" Jul 11 01:50:27.819778 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:27.819645 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71be99a5-e0a0-4f53-b32f-52b173c4b030-istio-envoy\") pod \"e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq\" (UID: \"71be99a5-e0a0-4f53-b32f-52b173c4b030\") " pod="openshift-ingress/e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq" Jul 11 01:50:27.820122 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:27.819789 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71be99a5-e0a0-4f53-b32f-52b173c4b030-istio-data\") pod \"e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq\" (UID: \"71be99a5-e0a0-4f53-b32f-52b173c4b030\") " pod="openshift-ingress/e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq" Jul 11 01:50:27.820122 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:27.819999 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71be99a5-e0a0-4f53-b32f-52b173c4b030-credential-socket\") pod \"e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq\" (UID: \"71be99a5-e0a0-4f53-b32f-52b173c4b030\") " pod="openshift-ingress/e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq" Jul 11 01:50:27.820122 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:27.820085 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71be99a5-e0a0-4f53-b32f-52b173c4b030-workload-certs\") pod \"e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq\" (UID: \"71be99a5-e0a0-4f53-b32f-52b173c4b030\") " pod="openshift-ingress/e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq" Jul 11 01:50:27.820122 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:27.820095 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71be99a5-e0a0-4f53-b32f-52b173c4b030-istiod-ca-cert\") pod \"e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq\" (UID: \"71be99a5-e0a0-4f53-b32f-52b173c4b030\") " pod="openshift-ingress/e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq" Jul 11 01:50:27.820258 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:27.820192 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71be99a5-e0a0-4f53-b32f-52b173c4b030-workload-socket\") pod \"e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq\" (UID: \"71be99a5-e0a0-4f53-b32f-52b173c4b030\") " pod="openshift-ingress/e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq" Jul 11 01:50:27.821948 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:27.821925 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71be99a5-e0a0-4f53-b32f-52b173c4b030-istio-envoy\") pod \"e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq\" (UID: \"71be99a5-e0a0-4f53-b32f-52b173c4b030\") " pod="openshift-ingress/e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq" Jul 11 01:50:27.822143 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:27.822123 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71be99a5-e0a0-4f53-b32f-52b173c4b030-istio-podinfo\") pod \"e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq\" (UID: \"71be99a5-e0a0-4f53-b32f-52b173c4b030\") " pod="openshift-ingress/e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq" Jul 11 01:50:27.827139 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:27.827118 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71be99a5-e0a0-4f53-b32f-52b173c4b030-istio-token\") pod \"e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq\" (UID: \"71be99a5-e0a0-4f53-b32f-52b173c4b030\") " pod="openshift-ingress/e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq" Jul 11 01:50:27.827242 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:27.827222 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gndg7\" (UniqueName: \"kubernetes.io/projected/71be99a5-e0a0-4f53-b32f-52b173c4b030-kube-api-access-gndg7\") pod \"e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq\" (UID: \"71be99a5-e0a0-4f53-b32f-52b173c4b030\") " pod="openshift-ingress/e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq" Jul 11 01:50:27.947374 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:27.947345 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq" Jul 11 01:50:28.084081 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:28.084053 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq"] Jul 11 01:50:28.086378 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:50:28.086347 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71be99a5_e0a0_4f53_b32f_52b173c4b030.slice/crio-893dd3cfc6607364e5c05516e7abd07a676ac3b39f3cf67ff0a6bb56768dcb7d WatchSource:0}: Error finding container 893dd3cfc6607364e5c05516e7abd07a676ac3b39f3cf67ff0a6bb56768dcb7d: Status 404 returned error can't find the container with id 893dd3cfc6607364e5c05516e7abd07a676ac3b39f3cf67ff0a6bb56768dcb7d Jul 11 01:50:28.088945 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:28.088916 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:50:28.088994 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:28.088979 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:50:28.089029 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:28.089005 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:50:28.717896 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:28.717861 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq" event={"ID":"71be99a5-e0a0-4f53-b32f-52b173c4b030","Type":"ContainerStarted","Data":"eedbed280c042d391bf262d57273fbf8d59f4d7509d64d08073781ab51a85fff"} Jul 11 01:50:28.718095 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:28.717915 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq" event={"ID":"71be99a5-e0a0-4f53-b32f-52b173c4b030","Type":"ContainerStarted","Data":"893dd3cfc6607364e5c05516e7abd07a676ac3b39f3cf67ff0a6bb56768dcb7d"} Jul 11 01:50:28.738134 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:28.738078 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq" podStartSLOduration=1.738060221 podStartE2EDuration="1.738060221s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:50:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:50:28.737248391 +0000 UTC m=+2633.068723950" watchObservedRunningTime="2026-07-11 01:50:28.738060221 +0000 UTC m=+2633.069535758" Jul 11 01:50:28.772004 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:28.771967 2572 patch_prober.go:28] interesting pod/e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 11 01:50:28.772163 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:28.772027 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs" podUID="b6ba1d17-5a8a-4977-8226-0e4658d1d759" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 11 01:50:28.947466 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:28.947426 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq" Jul 11 01:50:29.952634 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:29.952597 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq" Jul 11 01:50:30.726219 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:30.726188 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq" Jul 11 01:50:30.727055 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:30.727038 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq" Jul 11 01:50:31.980452 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:31.980425 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs" Jul 11 01:50:32.056626 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:32.056521 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6ba1d17-5a8a-4977-8226-0e4658d1d759-istio-envoy\") pod \"b6ba1d17-5a8a-4977-8226-0e4658d1d759\" (UID: \"b6ba1d17-5a8a-4977-8226-0e4658d1d759\") " Jul 11 01:50:32.056626 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:32.056567 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6ba1d17-5a8a-4977-8226-0e4658d1d759-credential-socket\") pod \"b6ba1d17-5a8a-4977-8226-0e4658d1d759\" (UID: \"b6ba1d17-5a8a-4977-8226-0e4658d1d759\") " Jul 11 01:50:32.056626 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:32.056594 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6ba1d17-5a8a-4977-8226-0e4658d1d759-workload-certs\") pod \"b6ba1d17-5a8a-4977-8226-0e4658d1d759\" (UID: \"b6ba1d17-5a8a-4977-8226-0e4658d1d759\") " Jul 11 01:50:32.056626 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:32.056615 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6ba1d17-5a8a-4977-8226-0e4658d1d759-istio-podinfo\") pod \"b6ba1d17-5a8a-4977-8226-0e4658d1d759\" (UID: \"b6ba1d17-5a8a-4977-8226-0e4658d1d759\") " Jul 11 01:50:32.056626 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:32.056632 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6ba1d17-5a8a-4977-8226-0e4658d1d759-istiod-ca-cert\") pod \"b6ba1d17-5a8a-4977-8226-0e4658d1d759\" (UID: \"b6ba1d17-5a8a-4977-8226-0e4658d1d759\") " Jul 11 01:50:32.057038 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:32.056647 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6ba1d17-5a8a-4977-8226-0e4658d1d759-workload-socket\") pod \"b6ba1d17-5a8a-4977-8226-0e4658d1d759\" (UID: \"b6ba1d17-5a8a-4977-8226-0e4658d1d759\") " Jul 11 01:50:32.057038 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:32.056676 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6ba1d17-5a8a-4977-8226-0e4658d1d759-istio-data\") pod \"b6ba1d17-5a8a-4977-8226-0e4658d1d759\" (UID: \"b6ba1d17-5a8a-4977-8226-0e4658d1d759\") " Jul 11 01:50:32.057038 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:32.056726 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nx5vg\" (UniqueName: \"kubernetes.io/projected/b6ba1d17-5a8a-4977-8226-0e4658d1d759-kube-api-access-nx5vg\") pod \"b6ba1d17-5a8a-4977-8226-0e4658d1d759\" (UID: \"b6ba1d17-5a8a-4977-8226-0e4658d1d759\") " Jul 11 01:50:32.057038 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:32.056764 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6ba1d17-5a8a-4977-8226-0e4658d1d759-istio-token\") pod \"b6ba1d17-5a8a-4977-8226-0e4658d1d759\" (UID: \"b6ba1d17-5a8a-4977-8226-0e4658d1d759\") " Jul 11 01:50:32.057038 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:32.056992 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6ba1d17-5a8a-4977-8226-0e4658d1d759-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b6ba1d17-5a8a-4977-8226-0e4658d1d759" (UID: "b6ba1d17-5a8a-4977-8226-0e4658d1d759"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 01:50:32.057299 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:32.056972 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6ba1d17-5a8a-4977-8226-0e4658d1d759-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b6ba1d17-5a8a-4977-8226-0e4658d1d759" (UID: "b6ba1d17-5a8a-4977-8226-0e4658d1d759"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 01:50:32.057299 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:32.057002 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6ba1d17-5a8a-4977-8226-0e4658d1d759-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b6ba1d17-5a8a-4977-8226-0e4658d1d759" (UID: "b6ba1d17-5a8a-4977-8226-0e4658d1d759"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 01:50:32.057299 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:32.057103 2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6ba1d17-5a8a-4977-8226-0e4658d1d759-credential-socket\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:50:32.057486 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:32.057462 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6ba1d17-5a8a-4977-8226-0e4658d1d759-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b6ba1d17-5a8a-4977-8226-0e4658d1d759" (UID: "b6ba1d17-5a8a-4977-8226-0e4658d1d759"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 11 01:50:32.057674 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:32.057652 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6ba1d17-5a8a-4977-8226-0e4658d1d759-istio-data" (OuterVolumeSpecName: "istio-data") pod "b6ba1d17-5a8a-4977-8226-0e4658d1d759" (UID: "b6ba1d17-5a8a-4977-8226-0e4658d1d759"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 01:50:32.058931 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:32.058895 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b6ba1d17-5a8a-4977-8226-0e4658d1d759-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b6ba1d17-5a8a-4977-8226-0e4658d1d759" (UID: "b6ba1d17-5a8a-4977-8226-0e4658d1d759"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 11 01:50:32.059038 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:32.058944 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6ba1d17-5a8a-4977-8226-0e4658d1d759-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b6ba1d17-5a8a-4977-8226-0e4658d1d759" (UID: "b6ba1d17-5a8a-4977-8226-0e4658d1d759"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 01:50:32.059391 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:32.059360 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6ba1d17-5a8a-4977-8226-0e4658d1d759-istio-token" (OuterVolumeSpecName: "istio-token") pod "b6ba1d17-5a8a-4977-8226-0e4658d1d759" (UID: "b6ba1d17-5a8a-4977-8226-0e4658d1d759"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 11 01:50:32.059391 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:32.059360 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6ba1d17-5a8a-4977-8226-0e4658d1d759-kube-api-access-nx5vg" (OuterVolumeSpecName: "kube-api-access-nx5vg") pod "b6ba1d17-5a8a-4977-8226-0e4658d1d759" (UID: "b6ba1d17-5a8a-4977-8226-0e4658d1d759"). InnerVolumeSpecName "kube-api-access-nx5vg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 11 01:50:32.158022 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:32.157983 2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6ba1d17-5a8a-4977-8226-0e4658d1d759-istio-envoy\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:50:32.158022 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:32.158015 2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6ba1d17-5a8a-4977-8226-0e4658d1d759-workload-certs\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:50:32.158022 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:32.158025 2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6ba1d17-5a8a-4977-8226-0e4658d1d759-istio-podinfo\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:50:32.158022 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:32.158033 2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6ba1d17-5a8a-4977-8226-0e4658d1d759-istiod-ca-cert\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:50:32.158289 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:32.158042 2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6ba1d17-5a8a-4977-8226-0e4658d1d759-workload-socket\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:50:32.158289 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:32.158052 2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6ba1d17-5a8a-4977-8226-0e4658d1d759-istio-data\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:50:32.158289 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:32.158061 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nx5vg\" (UniqueName: \"kubernetes.io/projected/b6ba1d17-5a8a-4977-8226-0e4658d1d759-kube-api-access-nx5vg\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:50:32.158289 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:32.158069 2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6ba1d17-5a8a-4977-8226-0e4658d1d759-istio-token\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:50:32.736173 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:32.736136 2572 generic.go:356] "Generic (PLEG): container finished" podID="b6ba1d17-5a8a-4977-8226-0e4658d1d759" containerID="5e1053207164fd3947732b98eb6c620ee850bc12aa454e218eb0208ec64f3da5" exitCode=0 Jul 11 01:50:32.736351 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:32.736188 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs" Jul 11 01:50:32.736351 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:32.736223 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs" event={"ID":"b6ba1d17-5a8a-4977-8226-0e4658d1d759","Type":"ContainerDied","Data":"5e1053207164fd3947732b98eb6c620ee850bc12aa454e218eb0208ec64f3da5"} Jul 11 01:50:32.736351 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:32.736277 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs" event={"ID":"b6ba1d17-5a8a-4977-8226-0e4658d1d759","Type":"ContainerDied","Data":"3249c2b212ec2fcbade5091d008233e02b6cd8d2745ba0ad4e3b4e3ed00759a3"} Jul 11 01:50:32.736351 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:32.736303 2572 scope.go:117] "RemoveContainer" containerID="5e1053207164fd3947732b98eb6c620ee850bc12aa454e218eb0208ec64f3da5" Jul 11 01:50:32.750922 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:32.750899 2572 scope.go:117] "RemoveContainer" containerID="41f39f05181bd1b78398ab4e44dcf5e3a65ec7017f0685050ab383b34000ed00" Jul 11 01:50:32.756777 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:32.756743 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs"] Jul 11 01:50:32.759298 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:32.759270 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-124c39-openshift-default-bf667cc6f-2njjs"] Jul 11 01:50:32.760368 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:32.760353 2572 scope.go:117] "RemoveContainer" containerID="5e1053207164fd3947732b98eb6c620ee850bc12aa454e218eb0208ec64f3da5" Jul 11 01:50:32.760656 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:50:32.760636 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e1053207164fd3947732b98eb6c620ee850bc12aa454e218eb0208ec64f3da5\": container with ID starting with 5e1053207164fd3947732b98eb6c620ee850bc12aa454e218eb0208ec64f3da5 not found: ID does not exist" containerID="5e1053207164fd3947732b98eb6c620ee850bc12aa454e218eb0208ec64f3da5" Jul 11 01:50:32.760751 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:32.760670 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e1053207164fd3947732b98eb6c620ee850bc12aa454e218eb0208ec64f3da5"} err="failed to get container status \"5e1053207164fd3947732b98eb6c620ee850bc12aa454e218eb0208ec64f3da5\": rpc error: code = NotFound desc = could not find container \"5e1053207164fd3947732b98eb6c620ee850bc12aa454e218eb0208ec64f3da5\": container with ID starting with 5e1053207164fd3947732b98eb6c620ee850bc12aa454e218eb0208ec64f3da5 not found: ID does not exist" Jul 11 01:50:32.760751 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:32.760711 2572 scope.go:117] "RemoveContainer" containerID="41f39f05181bd1b78398ab4e44dcf5e3a65ec7017f0685050ab383b34000ed00" Jul 11 01:50:32.760987 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:50:32.760971 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41f39f05181bd1b78398ab4e44dcf5e3a65ec7017f0685050ab383b34000ed00\": container with ID starting with 41f39f05181bd1b78398ab4e44dcf5e3a65ec7017f0685050ab383b34000ed00 not found: ID does not exist" containerID="41f39f05181bd1b78398ab4e44dcf5e3a65ec7017f0685050ab383b34000ed00" Jul 11 01:50:32.761027 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:32.760994 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41f39f05181bd1b78398ab4e44dcf5e3a65ec7017f0685050ab383b34000ed00"} err="failed to get container status \"41f39f05181bd1b78398ab4e44dcf5e3a65ec7017f0685050ab383b34000ed00\": rpc error: code = NotFound desc = could not find container \"41f39f05181bd1b78398ab4e44dcf5e3a65ec7017f0685050ab383b34000ed00\": container with ID starting with 41f39f05181bd1b78398ab4e44dcf5e3a65ec7017f0685050ab383b34000ed00 not found: ID does not exist" Jul 11 01:50:34.256835 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:34.256794 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6ba1d17-5a8a-4977-8226-0e4658d1d759" path="/var/lib/kubelet/pods/b6ba1d17-5a8a-4977-8226-0e4658d1d759/volumes" Jul 11 01:50:35.725026 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:35.724995 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l"] Jul 11 01:50:35.725487 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:35.725283 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6ba1d17-5a8a-4977-8226-0e4658d1d759" containerName="istio-proxy" Jul 11 01:50:35.725487 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:35.725295 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6ba1d17-5a8a-4977-8226-0e4658d1d759" containerName="istio-proxy" Jul 11 01:50:35.725487 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:35.725311 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6ba1d17-5a8a-4977-8226-0e4658d1d759" containerName="istio-proxy" Jul 11 01:50:35.725487 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:35.725317 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6ba1d17-5a8a-4977-8226-0e4658d1d759" containerName="istio-proxy" Jul 11 01:50:35.725487 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:35.725366 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b366829-3755-421d-b5d8-4b6a378262cd" containerName="istio-proxy" Jul 11 01:50:35.725487 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:35.725374 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6ba1d17-5a8a-4977-8226-0e4658d1d759" containerName="istio-proxy" Jul 11 01:50:35.725487 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:35.725381 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6ba1d17-5a8a-4977-8226-0e4658d1d759" containerName="istio-proxy" Jul 11 01:50:35.729789 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:35.729765 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l" Jul 11 01:50:35.732486 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:35.732466 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-98dbcb-openshift-default-dockercfg-dj2jv\"" Jul 11 01:50:35.740273 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:35.740250 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l"] Jul 11 01:50:35.789623 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:35.789589 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/69471a48-0ce6-4276-af31-3b8dd5076ba1-workload-certs\") pod \"e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l\" (UID: \"69471a48-0ce6-4276-af31-3b8dd5076ba1\") " pod="openshift-ingress/e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l" Jul 11 01:50:35.789623 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:35.789631 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/69471a48-0ce6-4276-af31-3b8dd5076ba1-credential-socket\") pod \"e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l\" (UID: \"69471a48-0ce6-4276-af31-3b8dd5076ba1\") " pod="openshift-ingress/e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l" Jul 11 01:50:35.789956 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:35.789658 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6n7q8\" (UniqueName: \"kubernetes.io/projected/69471a48-0ce6-4276-af31-3b8dd5076ba1-kube-api-access-6n7q8\") pod \"e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l\" (UID: \"69471a48-0ce6-4276-af31-3b8dd5076ba1\") " pod="openshift-ingress/e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l" Jul 11 01:50:35.789956 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:35.789796 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/69471a48-0ce6-4276-af31-3b8dd5076ba1-istio-token\") pod \"e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l\" (UID: \"69471a48-0ce6-4276-af31-3b8dd5076ba1\") " pod="openshift-ingress/e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l" Jul 11 01:50:35.789956 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:35.789847 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/69471a48-0ce6-4276-af31-3b8dd5076ba1-istiod-ca-cert\") pod \"e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l\" (UID: \"69471a48-0ce6-4276-af31-3b8dd5076ba1\") " pod="openshift-ingress/e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l" Jul 11 01:50:35.789956 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:35.789882 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/69471a48-0ce6-4276-af31-3b8dd5076ba1-istio-envoy\") pod \"e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l\" (UID: \"69471a48-0ce6-4276-af31-3b8dd5076ba1\") " pod="openshift-ingress/e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l" Jul 11 01:50:35.789956 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:35.789938 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/69471a48-0ce6-4276-af31-3b8dd5076ba1-workload-socket\") pod \"e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l\" (UID: \"69471a48-0ce6-4276-af31-3b8dd5076ba1\") " pod="openshift-ingress/e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l" Jul 11 01:50:35.790153 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:35.789975 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/69471a48-0ce6-4276-af31-3b8dd5076ba1-istio-podinfo\") pod \"e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l\" (UID: \"69471a48-0ce6-4276-af31-3b8dd5076ba1\") " pod="openshift-ingress/e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l" Jul 11 01:50:35.790153 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:35.789995 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/69471a48-0ce6-4276-af31-3b8dd5076ba1-istio-data\") pod \"e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l\" (UID: \"69471a48-0ce6-4276-af31-3b8dd5076ba1\") " pod="openshift-ingress/e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l" Jul 11 01:50:35.891001 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:35.890959 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/69471a48-0ce6-4276-af31-3b8dd5076ba1-workload-certs\") pod \"e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l\" (UID: \"69471a48-0ce6-4276-af31-3b8dd5076ba1\") " pod="openshift-ingress/e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l" Jul 11 01:50:35.891001 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:35.891003 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/69471a48-0ce6-4276-af31-3b8dd5076ba1-credential-socket\") pod \"e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l\" (UID: \"69471a48-0ce6-4276-af31-3b8dd5076ba1\") " pod="openshift-ingress/e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l" Jul 11 01:50:35.891262 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:35.891029 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6n7q8\" (UniqueName: \"kubernetes.io/projected/69471a48-0ce6-4276-af31-3b8dd5076ba1-kube-api-access-6n7q8\") pod \"e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l\" (UID: \"69471a48-0ce6-4276-af31-3b8dd5076ba1\") " pod="openshift-ingress/e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l" Jul 11 01:50:35.891262 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:35.891097 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/69471a48-0ce6-4276-af31-3b8dd5076ba1-istio-token\") pod \"e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l\" (UID: \"69471a48-0ce6-4276-af31-3b8dd5076ba1\") " pod="openshift-ingress/e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l" Jul 11 01:50:35.891262 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:35.891148 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/69471a48-0ce6-4276-af31-3b8dd5076ba1-istiod-ca-cert\") pod \"e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l\" (UID: \"69471a48-0ce6-4276-af31-3b8dd5076ba1\") " pod="openshift-ingress/e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l" Jul 11 01:50:35.891262 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:35.891192 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/69471a48-0ce6-4276-af31-3b8dd5076ba1-istio-envoy\") pod \"e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l\" (UID: \"69471a48-0ce6-4276-af31-3b8dd5076ba1\") " pod="openshift-ingress/e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l" Jul 11 01:50:35.891262 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:35.891230 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/69471a48-0ce6-4276-af31-3b8dd5076ba1-workload-socket\") pod \"e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l\" (UID: \"69471a48-0ce6-4276-af31-3b8dd5076ba1\") " pod="openshift-ingress/e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l" Jul 11 01:50:35.891262 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:35.891256 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/69471a48-0ce6-4276-af31-3b8dd5076ba1-istio-podinfo\") pod \"e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l\" (UID: \"69471a48-0ce6-4276-af31-3b8dd5076ba1\") " pod="openshift-ingress/e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l" Jul 11 01:50:35.891553 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:35.891293 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/69471a48-0ce6-4276-af31-3b8dd5076ba1-istio-data\") pod \"e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l\" (UID: \"69471a48-0ce6-4276-af31-3b8dd5076ba1\") " pod="openshift-ingress/e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l" Jul 11 01:50:35.891553 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:35.891406 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/69471a48-0ce6-4276-af31-3b8dd5076ba1-credential-socket\") pod \"e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l\" (UID: \"69471a48-0ce6-4276-af31-3b8dd5076ba1\") " pod="openshift-ingress/e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l" Jul 11 01:50:35.891553 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:35.891471 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/69471a48-0ce6-4276-af31-3b8dd5076ba1-workload-certs\") pod \"e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l\" (UID: \"69471a48-0ce6-4276-af31-3b8dd5076ba1\") " pod="openshift-ingress/e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l" Jul 11 01:50:35.891747 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:35.891638 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/69471a48-0ce6-4276-af31-3b8dd5076ba1-workload-socket\") pod \"e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l\" (UID: \"69471a48-0ce6-4276-af31-3b8dd5076ba1\") " pod="openshift-ingress/e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l" Jul 11 01:50:35.891812 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:35.891758 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/69471a48-0ce6-4276-af31-3b8dd5076ba1-istio-data\") pod \"e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l\" (UID: \"69471a48-0ce6-4276-af31-3b8dd5076ba1\") " pod="openshift-ingress/e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l" Jul 11 01:50:35.891965 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:35.891936 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/69471a48-0ce6-4276-af31-3b8dd5076ba1-istiod-ca-cert\") pod \"e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l\" (UID: \"69471a48-0ce6-4276-af31-3b8dd5076ba1\") " pod="openshift-ingress/e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l" Jul 11 01:50:35.893593 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:35.893575 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/69471a48-0ce6-4276-af31-3b8dd5076ba1-istio-envoy\") pod \"e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l\" (UID: \"69471a48-0ce6-4276-af31-3b8dd5076ba1\") " pod="openshift-ingress/e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l" Jul 11 01:50:35.893691 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:35.893679 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/69471a48-0ce6-4276-af31-3b8dd5076ba1-istio-podinfo\") pod \"e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l\" (UID: \"69471a48-0ce6-4276-af31-3b8dd5076ba1\") " pod="openshift-ingress/e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l" Jul 11 01:50:35.898969 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:35.898946 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/69471a48-0ce6-4276-af31-3b8dd5076ba1-istio-token\") pod \"e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l\" (UID: \"69471a48-0ce6-4276-af31-3b8dd5076ba1\") " pod="openshift-ingress/e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l" Jul 11 01:50:35.899196 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:35.899172 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6n7q8\" (UniqueName: \"kubernetes.io/projected/69471a48-0ce6-4276-af31-3b8dd5076ba1-kube-api-access-6n7q8\") pod \"e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l\" (UID: \"69471a48-0ce6-4276-af31-3b8dd5076ba1\") " pod="openshift-ingress/e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l" Jul 11 01:50:36.040298 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:36.040214 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l" Jul 11 01:50:36.181624 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:36.181585 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l"] Jul 11 01:50:36.183770 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:50:36.183744 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69471a48_0ce6_4276_af31_3b8dd5076ba1.slice/crio-10ae0b34373600b9d816852d690f5ea83fbdf1876c826a342c0c36f2603a41c4 WatchSource:0}: Error finding container 10ae0b34373600b9d816852d690f5ea83fbdf1876c826a342c0c36f2603a41c4: Status 404 returned error can't find the container with id 10ae0b34373600b9d816852d690f5ea83fbdf1876c826a342c0c36f2603a41c4 Jul 11 01:50:36.186027 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:36.185995 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:50:36.186128 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:36.186080 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:50:36.186128 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:36.186109 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:50:36.754942 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:36.754907 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l" event={"ID":"69471a48-0ce6-4276-af31-3b8dd5076ba1","Type":"ContainerStarted","Data":"4153f8ef08b0c1a905a7c444b2a3eb7378665e4035b246fb7ed0b5585dab4c4e"} Jul 11 01:50:36.755316 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:36.754962 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l" event={"ID":"69471a48-0ce6-4276-af31-3b8dd5076ba1","Type":"ContainerStarted","Data":"10ae0b34373600b9d816852d690f5ea83fbdf1876c826a342c0c36f2603a41c4"} Jul 11 01:50:37.040768 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:37.040656 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l" Jul 11 01:50:37.045432 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:37.045401 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l" Jul 11 01:50:37.064722 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:37.064641 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l" podStartSLOduration=2.064618848 podStartE2EDuration="2.064618848s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:50:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:50:36.771591761 +0000 UTC m=+2641.103067329" watchObservedRunningTime="2026-07-11 01:50:37.064618848 +0000 UTC m=+2641.396094393" Jul 11 01:50:37.759766 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:37.759733 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l" Jul 11 01:50:37.760732 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:37.760689 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l" Jul 11 01:50:44.790749 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:44.790631 2572 generic.go:356] "Generic (PLEG): container finished" podID="71be99a5-e0a0-4f53-b32f-52b173c4b030" containerID="eedbed280c042d391bf262d57273fbf8d59f4d7509d64d08073781ab51a85fff" exitCode=0 Jul 11 01:50:44.790749 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:44.790684 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq" event={"ID":"71be99a5-e0a0-4f53-b32f-52b173c4b030","Type":"ContainerDied","Data":"eedbed280c042d391bf262d57273fbf8d59f4d7509d64d08073781ab51a85fff"} Jul 11 01:50:44.791311 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:44.791177 2572 scope.go:117] "RemoveContainer" containerID="eedbed280c042d391bf262d57273fbf8d59f4d7509d64d08073781ab51a85fff" Jul 11 01:50:44.792801 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:44.792678 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:50:44.792966 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:44.792936 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:50:44.793079 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:44.793054 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:50:45.726891 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:45.726851 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq" Jul 11 01:50:45.797198 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:45.797163 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq" event={"ID":"71be99a5-e0a0-4f53-b32f-52b173c4b030","Type":"ContainerStarted","Data":"297d3b28c0df2184acbed512819f84eff6c05080b0179c6d1d179b08d4e899e6"} Jul 11 01:50:45.948326 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:45.948286 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq" Jul 11 01:50:45.949291 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:45.949266 2572 patch_prober.go:28] interesting pod/e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body= Jul 11 01:50:45.949410 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:45.949314 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq" podUID="71be99a5-e0a0-4f53-b32f-52b173c4b030" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" Jul 11 01:50:46.947954 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:46.947911 2572 patch_prober.go:28] interesting pod/e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body= Jul 11 01:50:46.948552 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:46.948516 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq" podUID="71be99a5-e0a0-4f53-b32f-52b173c4b030" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" Jul 11 01:50:47.948607 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:47.948566 2572 patch_prober.go:28] interesting pod/e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body= Jul 11 01:50:47.949245 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:47.949211 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq" podUID="71be99a5-e0a0-4f53-b32f-52b173c4b030" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" Jul 11 01:50:48.948612 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:48.948569 2572 patch_prober.go:28] interesting pod/e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body= Jul 11 01:50:48.949264 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:48.949229 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq" podUID="71be99a5-e0a0-4f53-b32f-52b173c4b030" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" Jul 11 01:50:49.948009 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:49.947965 2572 patch_prober.go:28] interesting pod/e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body= Jul 11 01:50:49.948313 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:49.948278 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq" podUID="71be99a5-e0a0-4f53-b32f-52b173c4b030" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" Jul 11 01:50:50.957969 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:50.957931 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq" Jul 11 01:50:50.958406 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:50.958310 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq" Jul 11 01:50:50.959180 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:50.959160 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq" Jul 11 01:50:53.800951 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:53.800900 2572 patch_prober.go:28] interesting pod/e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 11 01:50:53.801367 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:53.800978 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l" podUID="69471a48-0ce6-4276-af31-3b8dd5076ba1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 11 01:50:55.841995 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:55.841961 2572 generic.go:356] "Generic (PLEG): container finished" podID="69471a48-0ce6-4276-af31-3b8dd5076ba1" containerID="4153f8ef08b0c1a905a7c444b2a3eb7378665e4035b246fb7ed0b5585dab4c4e" exitCode=0 Jul 11 01:50:55.842412 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:55.842042 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l" event={"ID":"69471a48-0ce6-4276-af31-3b8dd5076ba1","Type":"ContainerDied","Data":"4153f8ef08b0c1a905a7c444b2a3eb7378665e4035b246fb7ed0b5585dab4c4e"} Jul 11 01:50:55.842511 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:55.842496 2572 scope.go:117] "RemoveContainer" containerID="4153f8ef08b0c1a905a7c444b2a3eb7378665e4035b246fb7ed0b5585dab4c4e" Jul 11 01:50:55.843504 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:55.843477 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:50:55.843557 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:55.843547 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:50:55.843597 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:55.843579 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 11 01:50:56.850544 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:56.850498 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l" event={"ID":"69471a48-0ce6-4276-af31-3b8dd5076ba1","Type":"ContainerStarted","Data":"a0c12bc0a8877144abeec600585e9f4429120343c08ccda76de73947950ed6d1"} Jul 11 01:50:57.041181 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:57.041081 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l" Jul 11 01:50:57.041555 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:57.041530 2572 patch_prober.go:28] interesting pod/e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body= Jul 11 01:50:57.041787 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:57.041744 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l" podUID="69471a48-0ce6-4276-af31-3b8dd5076ba1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" Jul 11 01:50:58.041192 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:58.041144 2572 patch_prober.go:28] interesting pod/e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body= Jul 11 01:50:58.041724 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:58.041263 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l" podUID="69471a48-0ce6-4276-af31-3b8dd5076ba1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" Jul 11 01:50:59.041862 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:59.041341 2572 patch_prober.go:28] interesting pod/e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body= Jul 11 01:50:59.041862 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:50:59.041427 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l" podUID="69471a48-0ce6-4276-af31-3b8dd5076ba1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" Jul 11 01:51:00.041381 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:51:00.041335 2572 patch_prober.go:28] interesting pod/e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body= Jul 11 01:51:00.041742 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:51:00.041688 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l" podUID="69471a48-0ce6-4276-af31-3b8dd5076ba1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" Jul 11 01:51:01.044114 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:51:01.044078 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l" Jul 11 01:51:01.044639 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:51:01.044457 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l" Jul 11 01:51:01.045332 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:51:01.045314 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l" Jul 11 01:57:41.698330 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:57:41.698247 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq"] Jul 11 01:57:41.698923 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:57:41.698505 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq" podUID="71be99a5-e0a0-4f53-b32f-52b173c4b030" containerName="istio-proxy" containerID="cri-o://297d3b28c0df2184acbed512819f84eff6c05080b0179c6d1d179b08d4e899e6" gracePeriod=30 Jul 11 01:57:46.951496 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:57:46.951469 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq" Jul 11 01:57:47.060528 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:57:47.060434 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gndg7\" (UniqueName: \"kubernetes.io/projected/71be99a5-e0a0-4f53-b32f-52b173c4b030-kube-api-access-gndg7\") pod \"71be99a5-e0a0-4f53-b32f-52b173c4b030\" (UID: \"71be99a5-e0a0-4f53-b32f-52b173c4b030\") " Jul 11 01:57:47.060528 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:57:47.060478 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71be99a5-e0a0-4f53-b32f-52b173c4b030-istio-token\") pod \"71be99a5-e0a0-4f53-b32f-52b173c4b030\" (UID: \"71be99a5-e0a0-4f53-b32f-52b173c4b030\") " Jul 11 01:57:47.060528 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:57:47.060505 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71be99a5-e0a0-4f53-b32f-52b173c4b030-istio-podinfo\") pod \"71be99a5-e0a0-4f53-b32f-52b173c4b030\" (UID: \"71be99a5-e0a0-4f53-b32f-52b173c4b030\") " Jul 11 01:57:47.060836 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:57:47.060550 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71be99a5-e0a0-4f53-b32f-52b173c4b030-istiod-ca-cert\") pod \"71be99a5-e0a0-4f53-b32f-52b173c4b030\" (UID: \"71be99a5-e0a0-4f53-b32f-52b173c4b030\") " Jul 11 01:57:47.060836 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:57:47.060604 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71be99a5-e0a0-4f53-b32f-52b173c4b030-workload-certs\") pod \"71be99a5-e0a0-4f53-b32f-52b173c4b030\" (UID: \"71be99a5-e0a0-4f53-b32f-52b173c4b030\") " Jul 11 01:57:47.060836 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:57:47.060632 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71be99a5-e0a0-4f53-b32f-52b173c4b030-workload-socket\") pod \"71be99a5-e0a0-4f53-b32f-52b173c4b030\" (UID: \"71be99a5-e0a0-4f53-b32f-52b173c4b030\") " Jul 11 01:57:47.060836 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:57:47.060658 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71be99a5-e0a0-4f53-b32f-52b173c4b030-istio-data\") pod \"71be99a5-e0a0-4f53-b32f-52b173c4b030\" (UID: \"71be99a5-e0a0-4f53-b32f-52b173c4b030\") " Jul 11 01:57:47.060836 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:57:47.060686 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71be99a5-e0a0-4f53-b32f-52b173c4b030-istio-envoy\") pod \"71be99a5-e0a0-4f53-b32f-52b173c4b030\" (UID: \"71be99a5-e0a0-4f53-b32f-52b173c4b030\") " Jul 11 01:57:47.061092 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:57:47.060951 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71be99a5-e0a0-4f53-b32f-52b173c4b030-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "71be99a5-e0a0-4f53-b32f-52b173c4b030" (UID: "71be99a5-e0a0-4f53-b32f-52b173c4b030"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 01:57:47.061092 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:57:47.060968 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71be99a5-e0a0-4f53-b32f-52b173c4b030-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "71be99a5-e0a0-4f53-b32f-52b173c4b030" (UID: "71be99a5-e0a0-4f53-b32f-52b173c4b030"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 01:57:47.061092 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:57:47.061032 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71be99a5-e0a0-4f53-b32f-52b173c4b030-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "71be99a5-e0a0-4f53-b32f-52b173c4b030" (UID: "71be99a5-e0a0-4f53-b32f-52b173c4b030"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 11 01:57:47.061092 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:57:47.061058 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71be99a5-e0a0-4f53-b32f-52b173c4b030-credential-socket\") pod \"71be99a5-e0a0-4f53-b32f-52b173c4b030\" (UID: \"71be99a5-e0a0-4f53-b32f-52b173c4b030\") " Jul 11 01:57:47.061307 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:57:47.061266 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71be99a5-e0a0-4f53-b32f-52b173c4b030-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "71be99a5-e0a0-4f53-b32f-52b173c4b030" (UID: "71be99a5-e0a0-4f53-b32f-52b173c4b030"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 01:57:47.061380 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:57:47.061357 2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71be99a5-e0a0-4f53-b32f-52b173c4b030-credential-socket\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:57:47.061437 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:57:47.061382 2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71be99a5-e0a0-4f53-b32f-52b173c4b030-istiod-ca-cert\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:57:47.061437 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:57:47.061396 2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71be99a5-e0a0-4f53-b32f-52b173c4b030-workload-certs\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:57:47.061437 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:57:47.061409 2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71be99a5-e0a0-4f53-b32f-52b173c4b030-workload-socket\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:57:47.061589 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:57:47.061546 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71be99a5-e0a0-4f53-b32f-52b173c4b030-istio-data" (OuterVolumeSpecName: "istio-data") pod "71be99a5-e0a0-4f53-b32f-52b173c4b030" (UID: "71be99a5-e0a0-4f53-b32f-52b173c4b030"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 01:57:47.062893 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:57:47.062866 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/71be99a5-e0a0-4f53-b32f-52b173c4b030-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "71be99a5-e0a0-4f53-b32f-52b173c4b030" (UID: "71be99a5-e0a0-4f53-b32f-52b173c4b030"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 11 01:57:47.062893 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:57:47.062880 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71be99a5-e0a0-4f53-b32f-52b173c4b030-kube-api-access-gndg7" (OuterVolumeSpecName: "kube-api-access-gndg7") pod "71be99a5-e0a0-4f53-b32f-52b173c4b030" (UID: "71be99a5-e0a0-4f53-b32f-52b173c4b030"). InnerVolumeSpecName "kube-api-access-gndg7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 11 01:57:47.062893 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:57:47.062892 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71be99a5-e0a0-4f53-b32f-52b173c4b030-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "71be99a5-e0a0-4f53-b32f-52b173c4b030" (UID: "71be99a5-e0a0-4f53-b32f-52b173c4b030"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 01:57:47.063166 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:57:47.063148 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71be99a5-e0a0-4f53-b32f-52b173c4b030-istio-token" (OuterVolumeSpecName: "istio-token") pod "71be99a5-e0a0-4f53-b32f-52b173c4b030" (UID: "71be99a5-e0a0-4f53-b32f-52b173c4b030"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 11 01:57:47.162446 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:57:47.162404 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gndg7\" (UniqueName: \"kubernetes.io/projected/71be99a5-e0a0-4f53-b32f-52b173c4b030-kube-api-access-gndg7\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:57:47.162446 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:57:47.162437 2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71be99a5-e0a0-4f53-b32f-52b173c4b030-istio-token\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:57:47.162446 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:57:47.162449 2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71be99a5-e0a0-4f53-b32f-52b173c4b030-istio-podinfo\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:57:47.162446 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:57:47.162457 2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71be99a5-e0a0-4f53-b32f-52b173c4b030-istio-data\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:57:47.162762 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:57:47.162466 2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71be99a5-e0a0-4f53-b32f-52b173c4b030-istio-envoy\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:57:47.553667 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:57:47.553629 2572 generic.go:356] "Generic (PLEG): container finished" podID="71be99a5-e0a0-4f53-b32f-52b173c4b030" containerID="297d3b28c0df2184acbed512819f84eff6c05080b0179c6d1d179b08d4e899e6" exitCode=0 Jul 11 01:57:47.553869 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:57:47.553689 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq" Jul 11 01:57:47.553869 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:57:47.553738 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq" event={"ID":"71be99a5-e0a0-4f53-b32f-52b173c4b030","Type":"ContainerDied","Data":"297d3b28c0df2184acbed512819f84eff6c05080b0179c6d1d179b08d4e899e6"} Jul 11 01:57:47.553869 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:57:47.553801 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq" event={"ID":"71be99a5-e0a0-4f53-b32f-52b173c4b030","Type":"ContainerDied","Data":"893dd3cfc6607364e5c05516e7abd07a676ac3b39f3cf67ff0a6bb56768dcb7d"} Jul 11 01:57:47.553869 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:57:47.553829 2572 scope.go:117] "RemoveContainer" containerID="297d3b28c0df2184acbed512819f84eff6c05080b0179c6d1d179b08d4e899e6" Jul 11 01:57:47.562724 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:57:47.562677 2572 scope.go:117] "RemoveContainer" containerID="eedbed280c042d391bf262d57273fbf8d59f4d7509d64d08073781ab51a85fff" Jul 11 01:57:47.570300 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:57:47.570282 2572 scope.go:117] "RemoveContainer" containerID="297d3b28c0df2184acbed512819f84eff6c05080b0179c6d1d179b08d4e899e6" Jul 11 01:57:47.570596 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:57:47.570574 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"297d3b28c0df2184acbed512819f84eff6c05080b0179c6d1d179b08d4e899e6\": container with ID starting with 297d3b28c0df2184acbed512819f84eff6c05080b0179c6d1d179b08d4e899e6 not found: ID does not exist" containerID="297d3b28c0df2184acbed512819f84eff6c05080b0179c6d1d179b08d4e899e6" Jul 11 01:57:47.570731 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:57:47.570602 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"297d3b28c0df2184acbed512819f84eff6c05080b0179c6d1d179b08d4e899e6"} err="failed to get container status \"297d3b28c0df2184acbed512819f84eff6c05080b0179c6d1d179b08d4e899e6\": rpc error: code = NotFound desc = could not find container \"297d3b28c0df2184acbed512819f84eff6c05080b0179c6d1d179b08d4e899e6\": container with ID starting with 297d3b28c0df2184acbed512819f84eff6c05080b0179c6d1d179b08d4e899e6 not found: ID does not exist" Jul 11 01:57:47.570731 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:57:47.570623 2572 scope.go:117] "RemoveContainer" containerID="eedbed280c042d391bf262d57273fbf8d59f4d7509d64d08073781ab51a85fff" Jul 11 01:57:47.570909 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:57:47.570893 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eedbed280c042d391bf262d57273fbf8d59f4d7509d64d08073781ab51a85fff\": container with ID starting with eedbed280c042d391bf262d57273fbf8d59f4d7509d64d08073781ab51a85fff not found: ID does not exist" containerID="eedbed280c042d391bf262d57273fbf8d59f4d7509d64d08073781ab51a85fff" Jul 11 01:57:47.570970 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:57:47.570915 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eedbed280c042d391bf262d57273fbf8d59f4d7509d64d08073781ab51a85fff"} err="failed to get container status \"eedbed280c042d391bf262d57273fbf8d59f4d7509d64d08073781ab51a85fff\": rpc error: code = NotFound desc = could not find container \"eedbed280c042d391bf262d57273fbf8d59f4d7509d64d08073781ab51a85fff\": container with ID starting with eedbed280c042d391bf262d57273fbf8d59f4d7509d64d08073781ab51a85fff not found: ID does not exist" Jul 11 01:57:47.577049 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:57:47.577021 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq"] Jul 11 01:57:47.580897 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:57:47.580875 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-696ed9-openshift-default-8f94dc4d7-9lvzq"] Jul 11 01:57:48.256551 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:57:48.256516 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71be99a5-e0a0-4f53-b32f-52b173c4b030" path="/var/lib/kubelet/pods/71be99a5-e0a0-4f53-b32f-52b173c4b030/volumes" Jul 11 01:58:07.772820 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:07.772788 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l"] Jul 11 01:58:07.773264 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:07.773002 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l" podUID="69471a48-0ce6-4276-af31-3b8dd5076ba1" containerName="istio-proxy" containerID="cri-o://a0c12bc0a8877144abeec600585e9f4429120343c08ccda76de73947950ed6d1" gracePeriod=30 Jul 11 01:58:13.024369 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:13.024344 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l" Jul 11 01:58:13.193420 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:13.193389 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/69471a48-0ce6-4276-af31-3b8dd5076ba1-istiod-ca-cert\") pod \"69471a48-0ce6-4276-af31-3b8dd5076ba1\" (UID: \"69471a48-0ce6-4276-af31-3b8dd5076ba1\") " Jul 11 01:58:13.193600 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:13.193434 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/69471a48-0ce6-4276-af31-3b8dd5076ba1-workload-certs\") pod \"69471a48-0ce6-4276-af31-3b8dd5076ba1\" (UID: \"69471a48-0ce6-4276-af31-3b8dd5076ba1\") " Jul 11 01:58:13.193600 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:13.193453 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/69471a48-0ce6-4276-af31-3b8dd5076ba1-istio-data\") pod \"69471a48-0ce6-4276-af31-3b8dd5076ba1\" (UID: \"69471a48-0ce6-4276-af31-3b8dd5076ba1\") " Jul 11 01:58:13.193600 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:13.193477 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/69471a48-0ce6-4276-af31-3b8dd5076ba1-istio-envoy\") pod \"69471a48-0ce6-4276-af31-3b8dd5076ba1\" (UID: \"69471a48-0ce6-4276-af31-3b8dd5076ba1\") " Jul 11 01:58:13.193600 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:13.193527 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/69471a48-0ce6-4276-af31-3b8dd5076ba1-istio-token\") pod \"69471a48-0ce6-4276-af31-3b8dd5076ba1\" (UID: \"69471a48-0ce6-4276-af31-3b8dd5076ba1\") " Jul 11 01:58:13.193600 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:13.193557 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/69471a48-0ce6-4276-af31-3b8dd5076ba1-workload-socket\") pod \"69471a48-0ce6-4276-af31-3b8dd5076ba1\" (UID: \"69471a48-0ce6-4276-af31-3b8dd5076ba1\") " Jul 11 01:58:13.193902 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:13.193625 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/69471a48-0ce6-4276-af31-3b8dd5076ba1-istio-podinfo\") pod \"69471a48-0ce6-4276-af31-3b8dd5076ba1\" (UID: \"69471a48-0ce6-4276-af31-3b8dd5076ba1\") " Jul 11 01:58:13.193902 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:13.193654 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/69471a48-0ce6-4276-af31-3b8dd5076ba1-credential-socket\") pod \"69471a48-0ce6-4276-af31-3b8dd5076ba1\" (UID: \"69471a48-0ce6-4276-af31-3b8dd5076ba1\") " Jul 11 01:58:13.193902 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:13.193693 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6n7q8\" (UniqueName: \"kubernetes.io/projected/69471a48-0ce6-4276-af31-3b8dd5076ba1-kube-api-access-6n7q8\") pod \"69471a48-0ce6-4276-af31-3b8dd5076ba1\" (UID: \"69471a48-0ce6-4276-af31-3b8dd5076ba1\") " Jul 11 01:58:13.193902 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:13.193761 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69471a48-0ce6-4276-af31-3b8dd5076ba1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "69471a48-0ce6-4276-af31-3b8dd5076ba1" (UID: "69471a48-0ce6-4276-af31-3b8dd5076ba1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 01:58:13.194095 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:13.193963 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69471a48-0ce6-4276-af31-3b8dd5076ba1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "69471a48-0ce6-4276-af31-3b8dd5076ba1" (UID: "69471a48-0ce6-4276-af31-3b8dd5076ba1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 01:58:13.194095 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:13.193985 2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/69471a48-0ce6-4276-af31-3b8dd5076ba1-workload-certs\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:58:13.194095 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:13.193998 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69471a48-0ce6-4276-af31-3b8dd5076ba1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "69471a48-0ce6-4276-af31-3b8dd5076ba1" (UID: "69471a48-0ce6-4276-af31-3b8dd5076ba1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 01:58:13.194095 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:13.194019 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69471a48-0ce6-4276-af31-3b8dd5076ba1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "69471a48-0ce6-4276-af31-3b8dd5076ba1" (UID: "69471a48-0ce6-4276-af31-3b8dd5076ba1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 11 01:58:13.194413 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:13.194388 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69471a48-0ce6-4276-af31-3b8dd5076ba1-istio-data" (OuterVolumeSpecName: "istio-data") pod "69471a48-0ce6-4276-af31-3b8dd5076ba1" (UID: "69471a48-0ce6-4276-af31-3b8dd5076ba1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 01:58:13.196025 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:13.195999 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69471a48-0ce6-4276-af31-3b8dd5076ba1-kube-api-access-6n7q8" (OuterVolumeSpecName: "kube-api-access-6n7q8") pod "69471a48-0ce6-4276-af31-3b8dd5076ba1" (UID: "69471a48-0ce6-4276-af31-3b8dd5076ba1"). InnerVolumeSpecName "kube-api-access-6n7q8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 11 01:58:13.196025 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:13.196009 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69471a48-0ce6-4276-af31-3b8dd5076ba1-istio-token" (OuterVolumeSpecName: "istio-token") pod "69471a48-0ce6-4276-af31-3b8dd5076ba1" (UID: "69471a48-0ce6-4276-af31-3b8dd5076ba1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 11 01:58:13.196268 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:13.196245 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69471a48-0ce6-4276-af31-3b8dd5076ba1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "69471a48-0ce6-4276-af31-3b8dd5076ba1" (UID: "69471a48-0ce6-4276-af31-3b8dd5076ba1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 01:58:13.196313 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:13.196282 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/69471a48-0ce6-4276-af31-3b8dd5076ba1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "69471a48-0ce6-4276-af31-3b8dd5076ba1" (UID: "69471a48-0ce6-4276-af31-3b8dd5076ba1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 11 01:58:13.295108 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:13.295069 2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/69471a48-0ce6-4276-af31-3b8dd5076ba1-istio-podinfo\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:58:13.295108 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:13.295101 2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/69471a48-0ce6-4276-af31-3b8dd5076ba1-credential-socket\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:58:13.295108 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:13.295112 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6n7q8\" (UniqueName: \"kubernetes.io/projected/69471a48-0ce6-4276-af31-3b8dd5076ba1-kube-api-access-6n7q8\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:58:13.295349 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:13.295122 2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/69471a48-0ce6-4276-af31-3b8dd5076ba1-istiod-ca-cert\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:58:13.295349 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:13.295131 2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/69471a48-0ce6-4276-af31-3b8dd5076ba1-istio-data\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:58:13.295349 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:13.295139 2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/69471a48-0ce6-4276-af31-3b8dd5076ba1-istio-envoy\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:58:13.295349 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:13.295146 2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/69471a48-0ce6-4276-af31-3b8dd5076ba1-istio-token\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:58:13.295349 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:13.295154 2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/69471a48-0ce6-4276-af31-3b8dd5076ba1-workload-socket\") on node \"ip-10-0-138-161.ec2.internal\" DevicePath \"\"" Jul 11 01:58:13.661468 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:13.661351 2572 generic.go:356] "Generic (PLEG): container finished" podID="69471a48-0ce6-4276-af31-3b8dd5076ba1" containerID="a0c12bc0a8877144abeec600585e9f4429120343c08ccda76de73947950ed6d1" exitCode=0 Jul 11 01:58:13.661468 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:13.661406 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l" Jul 11 01:58:13.661468 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:13.661439 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l" event={"ID":"69471a48-0ce6-4276-af31-3b8dd5076ba1","Type":"ContainerDied","Data":"a0c12bc0a8877144abeec600585e9f4429120343c08ccda76de73947950ed6d1"} Jul 11 01:58:13.661959 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:13.661508 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l" event={"ID":"69471a48-0ce6-4276-af31-3b8dd5076ba1","Type":"ContainerDied","Data":"10ae0b34373600b9d816852d690f5ea83fbdf1876c826a342c0c36f2603a41c4"} Jul 11 01:58:13.661959 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:13.661534 2572 scope.go:117] "RemoveContainer" containerID="a0c12bc0a8877144abeec600585e9f4429120343c08ccda76de73947950ed6d1" Jul 11 01:58:13.670940 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:13.670925 2572 scope.go:117] "RemoveContainer" containerID="4153f8ef08b0c1a905a7c444b2a3eb7378665e4035b246fb7ed0b5585dab4c4e" Jul 11 01:58:13.678103 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:13.678085 2572 scope.go:117] "RemoveContainer" containerID="a0c12bc0a8877144abeec600585e9f4429120343c08ccda76de73947950ed6d1" Jul 11 01:58:13.678343 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:58:13.678324 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0c12bc0a8877144abeec600585e9f4429120343c08ccda76de73947950ed6d1\": container with ID starting with a0c12bc0a8877144abeec600585e9f4429120343c08ccda76de73947950ed6d1 not found: ID does not exist" containerID="a0c12bc0a8877144abeec600585e9f4429120343c08ccda76de73947950ed6d1" Jul 11 01:58:13.678381 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:13.678353 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0c12bc0a8877144abeec600585e9f4429120343c08ccda76de73947950ed6d1"} err="failed to get container status \"a0c12bc0a8877144abeec600585e9f4429120343c08ccda76de73947950ed6d1\": rpc error: code = NotFound desc = could not find container \"a0c12bc0a8877144abeec600585e9f4429120343c08ccda76de73947950ed6d1\": container with ID starting with a0c12bc0a8877144abeec600585e9f4429120343c08ccda76de73947950ed6d1 not found: ID does not exist" Jul 11 01:58:13.678381 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:13.678370 2572 scope.go:117] "RemoveContainer" containerID="4153f8ef08b0c1a905a7c444b2a3eb7378665e4035b246fb7ed0b5585dab4c4e" Jul 11 01:58:13.678620 ip-10-0-138-161 kubenswrapper[2572]: E0711 01:58:13.678604 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4153f8ef08b0c1a905a7c444b2a3eb7378665e4035b246fb7ed0b5585dab4c4e\": container with ID starting with 4153f8ef08b0c1a905a7c444b2a3eb7378665e4035b246fb7ed0b5585dab4c4e not found: ID does not exist" containerID="4153f8ef08b0c1a905a7c444b2a3eb7378665e4035b246fb7ed0b5585dab4c4e" Jul 11 01:58:13.678664 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:13.678627 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4153f8ef08b0c1a905a7c444b2a3eb7378665e4035b246fb7ed0b5585dab4c4e"} err="failed to get container status \"4153f8ef08b0c1a905a7c444b2a3eb7378665e4035b246fb7ed0b5585dab4c4e\": rpc error: code = NotFound desc = could not find container \"4153f8ef08b0c1a905a7c444b2a3eb7378665e4035b246fb7ed0b5585dab4c4e\": container with ID starting with 4153f8ef08b0c1a905a7c444b2a3eb7378665e4035b246fb7ed0b5585dab4c4e not found: ID does not exist" Jul 11 01:58:13.682130 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:13.682111 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l"] Jul 11 01:58:13.687996 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:13.687975 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-98dbcb-openshift-default-867575c5f9-6c85l"] Jul 11 01:58:13.910839 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:13.910808 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68fcd49758-w5rpp_2b129304-ec54-472f-b487-057697e5f39a/copy-manifests/0.log" Jul 11 01:58:13.917113 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:13.917043 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68fcd49758-w5rpp_2b129304-ec54-472f-b487-057697e5f39a/manager/0.log" Jul 11 01:58:14.256493 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:14.256458 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69471a48-0ce6-4276-af31-3b8dd5076ba1" path="/var/lib/kubelet/pods/69471a48-0ce6-4276-af31-3b8dd5076ba1/volumes" Jul 11 01:58:18.187617 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:18.187587 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4959sk_df477daf-9329-4003-a53b-5b7ba9afb988/istio-proxy/0.log" Jul 11 01:58:18.301535 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:18.301494 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-v46fx_9c23564b-1287-4a50-bb42-04c91386672f/discovery/0.log" Jul 11 01:58:18.626789 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:18.626763 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-778tv_2599a499-058e-499f-bd0d-f33ce58e545b/istio-proxy/1.log" Jul 11 01:58:19.280455 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:19.280428 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-nt2jv_c4e9f492-8780-4d28-abf0-934916394663/main/0.log" Jul 11 01:58:19.711686 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:19.711661 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-c6fjm_9bfd7548-d524-404b-bed0-ac836e946495/main/0.log" Jul 11 01:58:26.551025 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:26.550989 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-vmt4r_99a7e6d5-7736-4a0e-b4c2-12f925deb1b2/global-pull-secret-syncer/0.log" Jul 11 01:58:26.681753 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:26.681723 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-f6sd8_80e2a675-663f-4959-89d2-c97483b65e4c/konnectivity-agent/0.log" Jul 11 01:58:26.733114 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:26.733082 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-161.ec2.internal_7d6d27db974b8b86e3da7428c71f54c4/haproxy/0.log" Jul 11 01:58:33.585015 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:33.584985 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-64889dfb8c-v7hq8_7b3e9af6-7640-4eb5-9bb0-6f7926523f5f/metrics-server/0.log" Jul 11 01:58:33.662000 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:33.661976 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5x9rv_4f564953-49e2-4981-93bf-f185049701e2/node-exporter/0.log" Jul 11 01:58:33.684376 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:33.684353 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5x9rv_4f564953-49e2-4981-93bf-f185049701e2/kube-rbac-proxy/0.log" Jul 11 01:58:33.714390 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:33.714362 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5x9rv_4f564953-49e2-4981-93bf-f185049701e2/init-textfile/0.log" Jul 11 01:58:37.184851 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:37.184813 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6hqjb/perf-node-gather-daemonset-f4x5p"] Jul 11 01:58:37.185197 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:37.185083 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69471a48-0ce6-4276-af31-3b8dd5076ba1" containerName="istio-proxy" Jul 11 01:58:37.185197 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:37.185093 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="69471a48-0ce6-4276-af31-3b8dd5076ba1" containerName="istio-proxy" Jul 11 01:58:37.185197 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:37.185106 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69471a48-0ce6-4276-af31-3b8dd5076ba1" containerName="istio-proxy" Jul 11 01:58:37.185197 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:37.185112 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="69471a48-0ce6-4276-af31-3b8dd5076ba1" containerName="istio-proxy" Jul 11 01:58:37.185197 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:37.185124 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71be99a5-e0a0-4f53-b32f-52b173c4b030" containerName="istio-proxy" Jul 11 01:58:37.185197 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:37.185129 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="71be99a5-e0a0-4f53-b32f-52b173c4b030" containerName="istio-proxy" Jul 11 01:58:37.185197 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:37.185136 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71be99a5-e0a0-4f53-b32f-52b173c4b030" containerName="istio-proxy" Jul 11 01:58:37.185197 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:37.185142 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="71be99a5-e0a0-4f53-b32f-52b173c4b030" containerName="istio-proxy" Jul 11 01:58:37.185197 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:37.185188 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="71be99a5-e0a0-4f53-b32f-52b173c4b030" containerName="istio-proxy" Jul 11 01:58:37.185197 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:37.185195 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="69471a48-0ce6-4276-af31-3b8dd5076ba1" containerName="istio-proxy" Jul 11 01:58:37.185197 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:37.185201 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="71be99a5-e0a0-4f53-b32f-52b173c4b030" containerName="istio-proxy" Jul 11 01:58:37.185537 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:37.185208 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="69471a48-0ce6-4276-af31-3b8dd5076ba1" containerName="istio-proxy" Jul 11 01:58:37.189371 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:37.189348 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6hqjb/perf-node-gather-daemonset-f4x5p" Jul 11 01:58:37.191783 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:37.191760 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6hqjb\"/\"kube-root-ca.crt\"" Jul 11 01:58:37.191892 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:37.191777 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6hqjb\"/\"default-dockercfg-j7bpp\"" Jul 11 01:58:37.192717 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:37.192646 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6hqjb\"/\"openshift-service-ca.crt\"" Jul 11 01:58:37.197929 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:37.197903 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6hqjb/perf-node-gather-daemonset-f4x5p"] Jul 11 01:58:37.298949 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:37.298913 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdgfd\" (UniqueName: \"kubernetes.io/projected/d0199cee-f7b8-4130-8676-607b55296571-kube-api-access-zdgfd\") pod \"perf-node-gather-daemonset-f4x5p\" (UID: \"d0199cee-f7b8-4130-8676-607b55296571\") " pod="openshift-must-gather-6hqjb/perf-node-gather-daemonset-f4x5p" Jul 11 01:58:37.299130 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:37.299043 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d0199cee-f7b8-4130-8676-607b55296571-podres\") pod \"perf-node-gather-daemonset-f4x5p\" (UID: \"d0199cee-f7b8-4130-8676-607b55296571\") " pod="openshift-must-gather-6hqjb/perf-node-gather-daemonset-f4x5p" Jul 11 01:58:37.299130 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:37.299097 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d0199cee-f7b8-4130-8676-607b55296571-sys\") pod \"perf-node-gather-daemonset-f4x5p\" (UID: \"d0199cee-f7b8-4130-8676-607b55296571\") " pod="openshift-must-gather-6hqjb/perf-node-gather-daemonset-f4x5p" Jul 11 01:58:37.299130 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:37.299114 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d0199cee-f7b8-4130-8676-607b55296571-proc\") pod \"perf-node-gather-daemonset-f4x5p\" (UID: \"d0199cee-f7b8-4130-8676-607b55296571\") " pod="openshift-must-gather-6hqjb/perf-node-gather-daemonset-f4x5p" Jul 11 01:58:37.299304 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:37.299221 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d0199cee-f7b8-4130-8676-607b55296571-lib-modules\") pod \"perf-node-gather-daemonset-f4x5p\" (UID: \"d0199cee-f7b8-4130-8676-607b55296571\") " pod="openshift-must-gather-6hqjb/perf-node-gather-daemonset-f4x5p" Jul 11 01:58:37.399947 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:37.399907 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d0199cee-f7b8-4130-8676-607b55296571-podres\") pod \"perf-node-gather-daemonset-f4x5p\" (UID: \"d0199cee-f7b8-4130-8676-607b55296571\") " pod="openshift-must-gather-6hqjb/perf-node-gather-daemonset-f4x5p" Jul 11 01:58:37.400072 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:37.399961 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d0199cee-f7b8-4130-8676-607b55296571-sys\") pod \"perf-node-gather-daemonset-f4x5p\" (UID: \"d0199cee-f7b8-4130-8676-607b55296571\") " pod="openshift-must-gather-6hqjb/perf-node-gather-daemonset-f4x5p" Jul 11 01:58:37.400072 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:37.399976 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d0199cee-f7b8-4130-8676-607b55296571-proc\") pod \"perf-node-gather-daemonset-f4x5p\" (UID: \"d0199cee-f7b8-4130-8676-607b55296571\") " pod="openshift-must-gather-6hqjb/perf-node-gather-daemonset-f4x5p" Jul 11 01:58:37.400072 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:37.400009 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d0199cee-f7b8-4130-8676-607b55296571-lib-modules\") pod \"perf-node-gather-daemonset-f4x5p\" (UID: \"d0199cee-f7b8-4130-8676-607b55296571\") " pod="openshift-must-gather-6hqjb/perf-node-gather-daemonset-f4x5p" Jul 11 01:58:37.400072 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:37.400035 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdgfd\" (UniqueName: \"kubernetes.io/projected/d0199cee-f7b8-4130-8676-607b55296571-kube-api-access-zdgfd\") pod \"perf-node-gather-daemonset-f4x5p\" (UID: \"d0199cee-f7b8-4130-8676-607b55296571\") " pod="openshift-must-gather-6hqjb/perf-node-gather-daemonset-f4x5p" Jul 11 01:58:37.400242 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:37.400063 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d0199cee-f7b8-4130-8676-607b55296571-sys\") pod \"perf-node-gather-daemonset-f4x5p\" (UID: \"d0199cee-f7b8-4130-8676-607b55296571\") " pod="openshift-must-gather-6hqjb/perf-node-gather-daemonset-f4x5p" Jul 11 01:58:37.400242 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:37.400077 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d0199cee-f7b8-4130-8676-607b55296571-podres\") pod \"perf-node-gather-daemonset-f4x5p\" (UID: \"d0199cee-f7b8-4130-8676-607b55296571\") " pod="openshift-must-gather-6hqjb/perf-node-gather-daemonset-f4x5p" Jul 11 01:58:37.400242 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:37.400131 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d0199cee-f7b8-4130-8676-607b55296571-proc\") pod \"perf-node-gather-daemonset-f4x5p\" (UID: \"d0199cee-f7b8-4130-8676-607b55296571\") " pod="openshift-must-gather-6hqjb/perf-node-gather-daemonset-f4x5p" Jul 11 01:58:37.400242 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:37.400189 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d0199cee-f7b8-4130-8676-607b55296571-lib-modules\") pod \"perf-node-gather-daemonset-f4x5p\" (UID: \"d0199cee-f7b8-4130-8676-607b55296571\") " pod="openshift-must-gather-6hqjb/perf-node-gather-daemonset-f4x5p" Jul 11 01:58:37.408269 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:37.408248 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdgfd\" (UniqueName: \"kubernetes.io/projected/d0199cee-f7b8-4130-8676-607b55296571-kube-api-access-zdgfd\") pod \"perf-node-gather-daemonset-f4x5p\" (UID: \"d0199cee-f7b8-4130-8676-607b55296571\") " pod="openshift-must-gather-6hqjb/perf-node-gather-daemonset-f4x5p" Jul 11 01:58:37.499886 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:37.499850 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6hqjb/perf-node-gather-daemonset-f4x5p" Jul 11 01:58:37.627036 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:37.627010 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6hqjb/perf-node-gather-daemonset-f4x5p"] Jul 11 01:58:37.629648 ip-10-0-138-161 kubenswrapper[2572]: W0711 01:58:37.629622 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd0199cee_f7b8_4130_8676_607b55296571.slice/crio-72746b6d8f4797c33296d9447e4b24158bd4293647fa24afeb04ddd597dc8c67 WatchSource:0}: Error finding container 72746b6d8f4797c33296d9447e4b24158bd4293647fa24afeb04ddd597dc8c67: Status 404 returned error can't find the container with id 72746b6d8f4797c33296d9447e4b24158bd4293647fa24afeb04ddd597dc8c67 Jul 11 01:58:37.759001 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:37.758926 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6hqjb/perf-node-gather-daemonset-f4x5p" event={"ID":"d0199cee-f7b8-4130-8676-607b55296571","Type":"ContainerStarted","Data":"e298ca3ae5a01cc70d239fa5a66ee066ba928fb5cdf19ccf3947e3ec784ed192"} Jul 11 01:58:37.759001 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:37.758980 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6hqjb/perf-node-gather-daemonset-f4x5p" event={"ID":"d0199cee-f7b8-4130-8676-607b55296571","Type":"ContainerStarted","Data":"72746b6d8f4797c33296d9447e4b24158bd4293647fa24afeb04ddd597dc8c67"} Jul 11 01:58:37.759173 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:37.759029 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6hqjb/perf-node-gather-daemonset-f4x5p" Jul 11 01:58:37.774467 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:37.774421 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6hqjb/perf-node-gather-daemonset-f4x5p" podStartSLOduration=0.77440481 podStartE2EDuration="774.40481ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 01:58:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:58:37.773043143 +0000 UTC m=+3122.104518707" watchObservedRunningTime="2026-07-11 01:58:37.77440481 +0000 UTC m=+3122.105880354" Jul 11 01:58:38.649445 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:38.649413 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-m8drm_dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64/dns/0.log" Jul 11 01:58:38.668618 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:38.668590 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-m8drm_dd1ab9c5-e4ae-417a-ae29-1b4fa8de7d64/kube-rbac-proxy/0.log" Jul 11 01:58:38.798081 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:38.798047 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jjd8d_e1e3c11c-1b4f-4101-8df4-2e9f1d13a67c/dns-node-resolver/0.log" Jul 11 01:58:39.321884 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:39.321853 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-57bf475f95-qf72c_f684db75-782a-4586-99bc-40de74226d3b/registry/0.log" Jul 11 01:58:39.366810 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:39.366785 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-46bl6_ec166c39-ac6d-4182-a8d6-fb0a34eb1915/node-ca/0.log" Jul 11 01:58:40.283924 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:40.283900 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4959sk_df477daf-9329-4003-a53b-5b7ba9afb988/istio-proxy/0.log" Jul 11 01:58:40.398146 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:40.398113 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-v46fx_9c23564b-1287-4a50-bb42-04c91386672f/discovery/0.log" Jul 11 01:58:40.474747 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:40.474693 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-778tv_2599a499-058e-499f-bd0d-f33ce58e545b/istio-proxy/0.log" Jul 11 01:58:40.504546 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:40.504488 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-778tv_2599a499-058e-499f-bd0d-f33ce58e545b/istio-proxy/1.log" Jul 11 01:58:41.270050 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:41.270020 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jvzch_a252a55d-e8b2-48a9-806e-8f1bae252f2a/serve-healthcheck-canary/0.log" Jul 11 01:58:41.858622 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:41.858589 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hh6v6_2de11321-a574-4567-9e84-a4d4dc1ba91a/kube-rbac-proxy/0.log" Jul 11 01:58:41.878428 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:41.878401 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hh6v6_2de11321-a574-4567-9e84-a4d4dc1ba91a/exporter/0.log" Jul 11 01:58:41.898165 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:41.898141 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hh6v6_2de11321-a574-4567-9e84-a4d4dc1ba91a/extractor/0.log" Jul 11 01:58:43.772835 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:43.772805 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6hqjb/perf-node-gather-daemonset-f4x5p" Jul 11 01:58:44.579040 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:44.578982 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68fcd49758-w5rpp_2b129304-ec54-472f-b487-057697e5f39a/manager/0.log" Jul 11 01:58:44.598171 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:44.598146 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68fcd49758-w5rpp_2b129304-ec54-472f-b487-057697e5f39a/copy-manifests/0.log" Jul 11 01:58:45.759937 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:45.759913 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-78b66d76bd-j7g9t_def65b05-657c-41f9-8e29-693603cf7c23/manager/0.log" Jul 11 01:58:47.258693 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:47.258652 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4959sk_df477daf-9329-4003-a53b-5b7ba9afb988/istio-proxy/0.log" Jul 11 01:58:47.362166 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:47.362137 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-v46fx_9c23564b-1287-4a50-bb42-04c91386672f/discovery/0.log" Jul 11 01:58:47.408083 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:47.408052 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-778tv_2599a499-058e-499f-bd0d-f33ce58e545b/istio-proxy/0.log" Jul 11 01:58:47.434198 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:47.434162 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-778tv_2599a499-058e-499f-bd0d-f33ce58e545b/istio-proxy/1.log" Jul 11 01:58:48.757235 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:48.757205 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4959sk_df477daf-9329-4003-a53b-5b7ba9afb988/istio-proxy/0.log" Jul 11 01:58:48.865665 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:48.865576 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-v46fx_9c23564b-1287-4a50-bb42-04c91386672f/discovery/0.log" Jul 11 01:58:48.917360 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:48.917324 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-778tv_2599a499-058e-499f-bd0d-f33ce58e545b/istio-proxy/0.log" Jul 11 01:58:48.951893 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:48.951862 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-778tv_2599a499-058e-499f-bd0d-f33ce58e545b/istio-proxy/1.log" Jul 11 01:58:52.604864 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:52.604836 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tlq4c_a817a6e0-4aaa-40d0-95f4-5daeb4481842/kube-multus-additional-cni-plugins/0.log" Jul 11 01:58:52.625284 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:52.625256 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tlq4c_a817a6e0-4aaa-40d0-95f4-5daeb4481842/egress-router-binary-copy/0.log" Jul 11 01:58:52.644564 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:52.644540 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tlq4c_a817a6e0-4aaa-40d0-95f4-5daeb4481842/cni-plugins/0.log" Jul 11 01:58:52.663404 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:52.663381 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tlq4c_a817a6e0-4aaa-40d0-95f4-5daeb4481842/bond-cni-plugin/0.log" Jul 11 01:58:52.683197 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:52.683174 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tlq4c_a817a6e0-4aaa-40d0-95f4-5daeb4481842/routeoverride-cni/0.log" Jul 11 01:58:52.703571 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:52.703545 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tlq4c_a817a6e0-4aaa-40d0-95f4-5daeb4481842/whereabouts-cni-bincopy/0.log" Jul 11 01:58:52.722010 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:52.721986 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tlq4c_a817a6e0-4aaa-40d0-95f4-5daeb4481842/whereabouts-cni/0.log" Jul 11 01:58:52.749751 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:52.749724 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-ff2g5_db99d519-c8a2-40f5-b238-123774baa78a/kube-multus/0.log" Jul 11 01:58:52.845952 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:52.845921 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4j8b6_6de25e6a-b433-4f08-941a-9666d215fe54/network-metrics-daemon/0.log" Jul 11 01:58:52.865634 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:52.865569 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4j8b6_6de25e6a-b433-4f08-941a-9666d215fe54/kube-rbac-proxy/0.log" Jul 11 01:58:53.945981 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:53.945947 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hww5x_bc650005-4617-49c3-a87c-ccd4c5d14b6f/ovn-controller/0.log" Jul 11 01:58:53.964090 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:53.964063 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hww5x_bc650005-4617-49c3-a87c-ccd4c5d14b6f/ovn-acl-logging/0.log" Jul 11 01:58:53.988851 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:53.988828 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hww5x_bc650005-4617-49c3-a87c-ccd4c5d14b6f/kube-rbac-proxy-node/0.log" Jul 11 01:58:54.012487 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:54.012459 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hww5x_bc650005-4617-49c3-a87c-ccd4c5d14b6f/kube-rbac-proxy-ovn-metrics/0.log" Jul 11 01:58:54.035090 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:54.035068 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hww5x_bc650005-4617-49c3-a87c-ccd4c5d14b6f/northd/0.log" Jul 11 01:58:54.055787 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:54.055762 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hww5x_bc650005-4617-49c3-a87c-ccd4c5d14b6f/nbdb/0.log" Jul 11 01:58:54.077292 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:54.077274 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hww5x_bc650005-4617-49c3-a87c-ccd4c5d14b6f/sbdb/0.log" Jul 11 01:58:54.126694 ip-10-0-138-161 kubenswrapper[2572]: I0711 01:58:54.126664 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hww5x_bc650005-4617-49c3-a87c-ccd4c5d14b6f/ovnkube-controller/0.log"